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SYSTEM AND METHOD FOR MODIFYING ADVERTISEMENT RESPONSIVE TO 

EPG INFORMATION 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is a continuation of U.S. Patent 
Application No. 09/595,216, filed June 16, 2000, which claims 
priority of U.S. Patent Application No. 09/120,488, filed July 
21, 1998, which claims priority of U.S. Provisional Patent 
Application Nos . 60/055,237, filed August 12, 1997, 60/068,375, 
filed December 22, 1997, 60/053,330, filed July 21, 1997, 
60/055,761, filed August 14, 1997, 60/061,119, filed October 6, 
1997, 60/071,811, filed January 20, 1998, 60/071,812, filed 
January 20, 1998, and 60/071,882, filed January 20, 1998, and 
U.S. Provisional Patent Application No. 60/034,784, filed 
December 19, 1996 and PCT International Application No. 
PCT/US97/23852, filed December 19, 1997, the disclosures of all 
of which are incorporated herein by reference, as if fully stated 
here, for all purposes. 

FIELD OF THE INVENTION 

The present invention relates generally to television 
systems, and more particularly, to the display of, and recording 
control interface with, television programs, video, advertising 
information and program scheduling information. 

BACKGROUND OF THE INVENTION 

Television viewers have historically analyzed the 
information provided by television program schedule guides to 
select television programs to watch. Historically, television 
program schedule guides have listed the available television 
programs by day of the week, time of day, channel, and program 
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title. Historically, only hardcopy television program schedule 
guides were available. More recently, as illustrated by the 
Levine Patent, U.S. Patent No. 4,908,713, television program 
guides have become available in electronic form. 

The earliest versions of on-screen electronic program guides 
("EPG") provided for the storage of program schedule information 
in an electronic memory connected to the television receiver and 
generally provided for the on-screen formatting and display of 
the program schedule information on the television screen. The 
early EPGs typically overlaid the television programming. 
Furthermore, viewer interaction capabilities with early EPGs was 
extremely limited. 

Later EPGs provided viewer-to-EPG interaction improvements 
and provided Picture-In-Guide ("PIG") display of the television 
program simultaneous with the display of the EPG. International 
Application No. PCT/US95/11173 (International Publication No. WO 
96/07270), the disclosure of which is incorporated by reference 
herein for all purposes, illustrates such an improvement. 

SUMMARY OF THE INVENTION 

The present invention is an improvement over previous EPGs 
in that it provides, among other things: 

A. Improved viewer interaction capabilities with the EPG; 

B. Improved viewer control of video recording of future- 
scheduled programming; 

C. Improved features to the EPG display and navigation; 

D. Parental control of the EPG display; 

E. Improved television program information access by the 
viewer; 

F. Improved opportunities for the commercial advertiser 
to reach the viewer; 

G. Improved product information access by the viewer; 

H. Creation of a viewer's profile; 
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I. Utilization of viewer profile information to customize 
various aspects of the EPG; and J. Utilization of viewer 
5 profile information to provide customized presentation of 

advertising to the viewer. 



m 
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DESCRIPTION OF THE DRAWINGS 

These and other features, aspects, and advantages of the 
10 present invention will become better understood with regard to 
the following description, appended claims, and accompanying 
drawings where: 

FIG.l is a graphic representation of a sample screen display 

p of the EPG. 

01 

| w < 15 FIG. 2 is a drawing of a portion of a remote control device 

N that shows keys for activating various functions of the EPG. 

FIG. 3 is a graphic representation of a sample on screen EPG 
|| display depicting the EPG's on-screen Grid Guide in the 

;S programming scrolling mode. 

h 20 FIGS. 4a and 4b is a graphic representation of a sample on 

f* screen EPG display depicting the EPG 7 s on-screen Grid Guide in 

the channel -scrolling . 

FIG. 5 is a graphic representation of a sample on screen EPG 
display depicting the EPG in the Watch Scheduling mode. 
25 FIG. 6 is a graphic representation of a sample on screen EPG 

display depicting the Watch/Record Schedule screen of the EPG. 

FIG. 7 is a graphic representation of a sample on screen EPG 
display depicting the top level theme screen display of the EPG. 
FIG. 8 is a graphic representation of a sample on screen EPG 
30 display depicting the second-level theme screen display of the 
EPG. 

FIG. 9 is a graphic representation of a sample on screen EPG 
display depicting the Channel Guide function of the EPG. 

FIGS. 10a and 10b are graphic representations of sample on 
35 screen EPG displays depicting one embodiment of the feature of 
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presenting additional information concerning the subject matter 
of a highlighted Panel Ad Window. 

5 

DETAILED DESCRIPTION OF THE INVENTION 

The disclosure of International Application WO96/07270, 
published on March 7, 1996 is incorporated fully herein by 
reference. The present invention is an improvement on the 
10 electronic program guide (EPG) disclosed therein. The apparatus 
disclosed in the referenced PCT application is used to generate 
p the screen displays described below. 

jjp In FIG. 1 of the drawing, one embodiment of the EPG with Ad 

IP Window and Advertising Messages is shown. In FIG. 1, a 

p 15 television screen display 10 is shown. Display 10 could be 
M generated by a conventional television receiver with interlaced 

scan lines, by a VCR, by a PC monitor with progressive scan 
lines, or by another other type of video display device. In the 
upper left hand corner of the screen is a PIP window 12. Below 
S 20 window 12 are Panel Ad Windows 14, and 16 ("Ad Windows") - 
RJ Windows 12, 14, and 16 each typically occupy about 1/9 of the 

total screen area. The remainder of the screen area is typically 
occupied (moving from top to bottom of the screen) by an action 
key bar 18, a navigation bar 20, a grid guide 22 ("Grid Guide") , 
25 and an information box 24 (the "detailed information area) . In 
the embodiment pictured in FIG. 1, the position of the windows, 
and other user interface features, including the action key bar, 
navigation bar and Grid Guide, are fixed. In another embodiment 
of this invention, as is described further below, the position 
30 and size of the windows and other user interface features are 
customizable by the viewer. 

In FIG. 2 of the drawing, one embodiment of a remote 
controller 26 for activating the functions of display 10 is 
shown. Remote controller 26 could have other keys for activating 
35 the functions of a user video device, such as a television 
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receiver, a VCR, or a cable box. Remote control 26 has up, down, 
right, and left arrows keys 28, 30, 32, and 34, respectively, for 
5 controlling the movement of a cursor 36 on display 10. Cursor 
36 can select, i.e., highlight, any of windows 12, 14, or 16 by 
pressing arrow keys 28 to 34, any of the titles and channels in 
Grid Guide 22 by pressing arrow keys 32 and 34, or navigation bar 
20 by pressing arrow keys 32 and 34. Windows 12, 14, and 16 are 
10 highlighted by adding a border around the window or changing the 
1^ color of the border, if the border is permanent. The titles and 

p channels in Grid Guide 22 and navigation bar 20 are highlighted 

ill by changing color. 

™* Highlighting of windows and/or viewer selections from the 

0.1:' 

|i 15 Grid Guide and/or navigation and EPG on screen display components 
may be accomplished in a number of other ways. For instance, the 



f% border of a selected window, or the selected Grid Guide or 



navigation component, can be made to appear to flash. Another 
way to highlight a viewer selection is to make the selected 
CI 2 0 window or feature appear to become brighter than the rest of the 
on screen display. Yet another way to highlight a viewer 
selection is to blur all portions of the on screen display, 
except for the viewer selected component. Still another way to 
highlight a viewer selection is to make all portions of the on 
25 screen display, except for the viewer selected component, appear 
transparent. Still yet another way to highlight a viewer 
selection is to add animation to the selected component. When 
a portion of the EPG is selected, the system issues graphic 
display commands to the on screen display (OSD) controller to 
30 implement one or more of the desired enhancement technique ( s ) . 

The viewer enters the Guide Mode illustrated in FIG. 1 by 
pressing a "guide" key 35 and returns to the full screen 
Television Mode by pressing key 35 again or by pressing the 
"select" key. A real time television program is displayed in 
35 window 12. A translucent overlay of the PIP window 12 can 
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display the title, channel (local number and/or station name), 
and status (locked or unlocked) of window 12 over the television 
5 program so the viewer can still see the entire image. 

The PIP Window can be locked or unlocked. The "lock/unlock" 
mode is user controlled. To lock or unlock the PIP Window, the 
viewer can use a PIP button on the remote control device, or can 
highlight and press the Lock/Unlock EPG action button. The 
10 lock/unlock status is recorded and maintained until the status 
^ is reset by the viewer. That is, the lock/unlock status for the 

PIP Window in the EPG is maintained when the viewer leaves the 
p| Guide and later re-enters the Guide, including when the viewer 

51 turns off the television. If the viewer selects the "lock" 

15 status, the last channel to which the tuner was set in the PIP 
^* Window continues to be displayed regardless of the actions 

■ exercised by the viewer. In the unlocked status, the channel 

n 

fp highlighted by cursor 36 in Grid Guide 22 is displayed if the 

Q Grid Guide is displaying currently telecast programs and the last 

20 currently telecast channel that was highlighted is displayed if 
fjj the Grid Guide is displaying future programs. 

There are generally three results to leaving the Guide, 
depending upon the way the viewer leaves the Guide. If the 
viewer, while in the EPG, wants to watch in full screen mode the 
25 program shown in the PIP Window, then the viewer can press the 
Guide button on the remote control device. If the viewer, while 
in the EPG, highlights a particular channel in the Grid Guide, 
and then presses the "select" button, the viewer will leave the 
Guide to view in the full screen mode the television program that 
30 the viewer highlighted in the Guide. If the viewer, while in the 
EPG, presses the "clear" or "cancel" button on the remote control 
device, then the viewer will leave the Guide and return to the 
television program that the viewer was watching immediately 
before entering the Guide. 

35 
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Typically, an ad for a future telecast program is displayed 
in window 14. This ad is linked to the time and channel of the 
5 program in RAM so the viewer can watch or record the program 
automatically by pressing the blue left action button to watch 
the program, or the green right action button to record the 
program- 
Typically, an ad for a product or service is displayed in 
10 window 16. This ad is linked to more information about the 
product or service in RAM so the viewer can read one or more 
pages about the product or service in window 16 by pressing an 
|5 "info" key 40 one or more times. Alternatively, this ad is 

IP linked to the time and channel in RAM that an infomercial about 

H 15 the product or service will be telecast so the viewer can watch 
or record the infomercial automatically by pressing "select" key 
% 42. 

CI 

|ij Bar 18 displays a blue button 44 and/or a green button 46 

Ci with legends that depend upon the context of the information 

|K 20 displayed on the screen. Remote controller 26 has corresponding 
f|J keys 48 and 50, respectively, to activate the functions 

represented by blocks 44 and 46. 

From window 12, 14, or 16 the viewer moves to grid guide 22 
by pressing arrow key 32. (From grid guide 22 the viewer moves 
25 to window 12, 14, or 16 by pressing arrow key 34.) In grid guide 
22 the viewer moves cursor 36 to highlight one of the nine tiles 
in which channel and title are displayed by pressing arrow keys 
28 and 30. The viewer can view program listings scheduled at 
future times by pressing keys 32 or 34 to move horizontally about 
30 the Grid. 

From grid guide 22 the viewer moves to navigation bar 20 by 
pressing arrow key 28. Initially, the center button is 
highlighted. To highlight a different button, arrow key 32 or 
34 is pressed. To enter the screen represented by the 
35 highlighted button, "select" key 42 is pressed. 
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In grid guide 22 details about the program represented by 
the highlighted tile are displayed. If more information is 
5 available this fact is indicated by an icon and such information 
is displayed in the area occupied by grid guide 22, instead of 
the grid guide by pressing "info" key 40. To return to the grid 
guide, "info" key 40 is pressed again. After an action button 
has been pressed or an icon on navigation bar 20 has been 
10 activated, an instructional prompt may be substituted for the 
program information in information box 24. 

In addition to the tiles representing television programs, 
a virtual channel ad can be displayed in grid guide 22 on a tile 
|p 52. A virtual channel ad may promote, for instance, a current 

W 15 or future television program. Such a virtual channel ad for a 
television program is linked to the time and channel of the progr 
am in RAM so the viewer can watch or record the program 
automatically by pressing "select" key 42 in the manner described 
in the referenced application. More than one virtual channel ad 



20 may be stored in RAM, but preferably only one such ad is 
fjj displayed at a time. 

Reference is made to the TV Guide Plus+ 98 User Interface 
Specification vl.42stv, which is attached hereto as Appendix A, 
the disclosure of which is incorporated by reference as if fully 
25 stated herein, for more description of the invention. 

One embodiment of the hardware for this invention includes 
a circuit board consisting of a gate array that provides all of 
the control functions for access by the processor (e.g., Motorola 
68000), control of memory (dynamic RAM and external ROM), and 
30 some peripheral functions such as infrared ("IR") input and 
output, frequency synthesizer for the paging system, and data 
acquisition from the paging system. Inside there is a module for 
creating an on-screen display including a programmable DMA 
(direct memory access) controller, a color lookup table that 
35 provides for a field called a color index that can be used to 
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select a more complicated color (more bits than can be expressed 
in the bit map), first-in-first-out ("FIFO") memory for ordering 

5 the pixels (which allows the system to write the pixels as fast 
as the system is capable of writing the pixels and then sending 
the pixels to the display according to a prescribed timing. 
Included in the chip is a timing subsystem that produces a number 
of different timing signals of varying f requency--f rom clocks to 

10 long millisecond time measurement, and interrupts. 

h* Synchronization signals for the television monitor are also 

in 

|S generated by the internal timing subsystem. The system also 

||l typically includes circuits for functions including but not 

E! limited to: data receiver, memory controller, timing interface 

I,* 15 with the processor, data deinterleaving, error correcting, and 
synchronous timing generator with horizontal and vertical 
|3 counters . 

Hi Another feature of one embodiment of the EPG system hardware 

|« is that display list hardware is capable of both video input and 

13 20 output on the same DMA hardware. The display processor is 
,w comprised of a video section and a FIFO section in an ASIC. The 

system has multiple clocks. The display memory has the 
capability to store 8 screen tiles in a horizontal plane. 

Described below in more detail are the following 
25 improvements to an EPG: 

A. Improved viewer interaction capabilities with the EPG, 
including : 

1. A Variety of Operating Modes. 

2. Joy Stick and Track Ball Viewer Remote Interface. 
30 3. Contextually Sensitive EPG On-Screen Control 

Mechanisms . 

4. Watch Scheduling. 

5. "All Channel" Guide Format, Channel Guide Format 
and "Next'V'Previous" Channel Guide. 

35 
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B. Improved viewer control of video recording of future- 
scheduled programming, including: 
5 1. Recording program displayed in PIP window. 

2. Recording "Regularly . " 

3. Record Function rerun filter for "Regularly'' 
recorded programs. 

4. Skip recording instruction. 
10 5. Automatic Record List Update. 

6. Recording on recordable Digital Video Discs. 

7. Speed Sensitive Tape Capacity. 

||1 8. Record Instruction Conflict Resolution. 

ff'y. 

£; 9. Recording from Theme Guides. 

y 15 c. Improved features to the EPG display and navigation, 

including: 
pi 1. E-mail. 

HI 2. Multiple Viewable "Windows. " 

£l 3. Translucency on-screen effects. 

13 on 4. On-screen notifications. 

5. Theme navigation bar. 

6. Improved Scrolling through the EPG and Smooth 
Scrolling. 

7. "Jumping" in the EPG. 

25 8. Thematic color-coding of program schedule. 

9. Controllable number of days of programming. 

D. Parental control of the EPG display; 

E. Improved television program information access by the 
viewer, including : 

30 1. Virtual Channel Ad Slots and Ad Window program 

advertisements . 
2. Additional detailed information for viewer access 
including link to the Internet. 

F. Improved opportunities for the commercial advertiser 
35 to reach the viewer, including: 
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1. Ad Window product-related video clips and 
inf omercial recording . 
5 2 . Ad Window program-related recording. 

3. Panel Ads. 

4. Virtual Channel Ad Slots. 

5. Placeholder Ads 

6. Full Screen ads. 
10 7. Automatic watch channel. 

H 8 . Ad Features . 

G. Improved product information access by the viewer, 
including: 

|-~ 1. Ad Window product detail. 

M 15 2. Ad Window product-related recording. 

3. Ad Window program-related recording. 
|3 H. Creation of a viewer's profile, including: 

I'll 1. Collecting viewer profile information. 

% 2. Analyzing and characterizing viewer profile 

Q 20 information. 

Hi 

I. Utilization of viewer profile information to customize 
various aspects of the EPG; and J. Utilization of viewer 
profile information to provide customized presentation of 
advertising to the viewer. 



25 



Improved Viewer Interaction Capabilities With The EPG 



1 . A Variety of Operating Modes . 

Under the improved EPG system, there are multiple modes in 
30 which the viewer can operate the television. 



a. Television Mode. 

In the Television Mode, the viewer watches a full screen 
display of the television video programming. In one embodiment, 
35 in order to enter the EPG, the viewer presses the "Guide" key on 
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the viewer's remote control device. In another embodiment, the 
EPG Grid Guide is the default mode. In the case where the EPG 
Grid Guide is the default mode, when the viewer turns the 
television on, the first thing that the viewer sees is the EPG 
in Grid Guide Mode as is described more fully below. In one 
embodiment, at the viewer's option, as identified in the EPG set 
up procedure, the viewer can override the EPG Grid Guide default 
mode by selecting to automatically enter the Television Mode 
whenever the viewer first turns on the television. During setup 
procedures, the viewer can further instruct the EPG to 
automatically tune to the last-watched channel as identified when 
the viewer last turned off the television. The viewer can 
further instruct the EPG to automatically tune to the viewer's 
favorite channel, as is deduced from analyzing the viewer's 
profile information, described below. Alternatively, the viewer 
can instruct the EPG to automatically tune to a particular 
channel, e.g., a news channel such as CNN. 



b. EPG Grid Guide Mode. 

In the EPG Grid Guide Mode, the EPG displays the Grid Guide, 
or in the alternative, a Channel Guide. The viewer can request 
that the Grid Guide occupy the entire screen, be displayed over 
a portion of the screen as an overlay of the video television 
programming, or, in the preferred embodiment, occupy only a 
portion of the screen, typically 2/3 of the entire screen, while 
continuing to show the video television programming in the PIP 
Window of the screen. In the preferred embodiment, multiple 
Windows are displayed for the viewer, as are further described 
below, including at least: the EPG/Grid Guide Window, the PIP 
Window, and the Ad Window. 

Scrolling through the Guide is described below. The viewer 
can press the "Menu" key on the viewer's remote control device 
to go to the top of the Guide. 
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The viewer can return to the full screen display of the 
video television programming in a number of ways. One way is to 
5 press the "Guide" key on the viewer's remote control device. 
Another way is to press the "Select"" key on the viewer's remote 
control device when the on-screen highlighting/cursor is 
highlighting a particular program listing on the Grid Guide for 
a program that is available for real-time viewing. Another way 
10 is to press the "last channel" key on the viewer's remote control 
y : device to return to the program the viewer was watching before 

0 entering the Guide, or the last program on which the PIP window 

ft 

gl was locked (an option explained further below) . 

§! 

m 

f; 15 1.) Theme Guide Function. 

y The EPG provides various Theme Guides, e.g., sports, movies, 

news, etc. Each Theme Guide presents program listings associated 

III with a particular theme, e.g., all sports programs. The Theme 
Guide display format only displays program listings, and 

% 20 consequently channels, for certain times of the day, with content 

f|| appropriate for the selected theme. For instance, the Sports 

Theme Guide will display, typically in schedule order, only 
listings for channels that carry sports programs that are 
scheduled during a certain period of time, e.g., 48 hours, 8 
25 days, etc. 

2 . ) Record Selection Function . 

In the Record Selection Function, also referred to as the 
Recording Function, the viewer instructs the EPG what programs 
30 to add to the Record List, which is the list of programs and 
related programming schedule information, for programs that the 
viewer want to have recorded. As is further described below, the 
viewer can identify the frequency/regularity with which the 
viewer wants to record each program listed in the Record List. 

35 
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The viewer can enter the Recording Function in a number of 
ways. The viewer can press the "Record" key, if there is one, 
on the viewer's remote control device. Alternatively, the viewer 
can "press" a "Record" action button on the EPG display. 

3. ) Watch Scheduling Function. 

In the Watch Scheduling Function, also referred to as the 
Watch Function, the viewer instructs the EPG what programs to add 
to the Watch List, which is the list of programs and related 
programming schedule information, for programs that the viewer 
want to watch. As is further described below, the viewer can 
identify the frequency/regularity with which the viewer wants to 
watch each program listed in the Watch List. 

The viewer can enter the Watch Function in a number of ways. 
The viewer can press the "Watch" key, if there is one, on the 
viewer's remote control device. Alternatively, the viewer can 
"press" a "Watch" action button on the EPG display. 

4 . ) Data Download Function . 

In some embodiments, data for the EPG schedule, and/or 
supplemental information relevant to the program listings, and/or 
advertising data, can be downloaded to the memory resident at the 
viewer's television system. In the preferred embodiment of the 
download data system, the viewer will ask the EPG to make certain 
types of information available; the EPG will use an index of 
where to find the information and will automatically connect to 
the appropriate data source and will download the information. 

Data for the EPG schedule, and/or supplemental information 
relevant to the program listings, and/or advertising data, can 
be downloaded from various sources. In one embodiment, data is 
downloaded from the Internet. In other embodiments of the 
download data system, the viewer is asked to tune to a particular 
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0 



channel at a particular time if the viewer is interested in 
accessing and downloading particular types of information. 

5 

c. Internet Mode. 

Not all embodiments require that data be downloaded to the 
EPG memory. In one embodiment, the EPG scheduling data, 
supplemental data and/or advertising data and the software to 
10 format, display, and navigate the EPG scheduling data, 
supplemental data and/or advertising data is accessed by the 
viewer's television system through a direct link between the 
viewer's television system and the Internet. 

In one embodiment of the above-described direct-link to the 
2 15 Internet, the viewer's television is connected to the Internet 
M by telephone line via modem, Jby cable modem, by other two-way 
1U communication device, including wireless modem communication 

III devices and by other conventional methods of communicating with 

ft the Internet. The initial connect web site address may be 

fill 20 supplied, for instance, through information transmitted to the 
^ viewer's television over the vertical blanking interval (the 

M VBI") . The viewer may also be provided with a selection of 
multiple EPG Internet web sites. The viewer uses the remote 
control device to select one of the EPG Internet web sites 
25 The viewer's television system is programmed to emulate 

computer on-line access to the Internet. Once the connection 
between the viewer's television system and the Internet is made, 
the user has two-way communication with the on-line Internet 
service provider of the EPG related information. The user can 
30 then navigate through the EPG. Furthermore, in one embodiment, 
in which keyboard user interface is available, the user can 
enter chat rooms or other interactive services. 



35 
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2 . Jov Stick and Track Ball Viewer Remote Interface. 

The viewing user's video interface (UI) comprises the 
5 viewer's remote control device and the television monitor screen 
display. In one embodiment of the present invention, one 
improvement in the UI offered by the present invention is the use 
of a joy stick as a substitute for the traditional remote control 
device configuration of a circle of four (4) arrow keys (up, 
10 down, left and right) with a select key in the center. The joy 
|4 ; stick UI provides a user-friendly interface with the EPG. Use 
C? of the joy stick is intuitive. The viewer/ user does not have 
fir to look at the remote once the viewer's finger contacts the 
ft 1 remote control joy stick. Accordingly, the viewer can control 

C 15 the UI while simultaneously watching, without interruption, the 
M on-screen display. 

L In another embodiment of the present invention, one 

fl| improvement in the UI offered by the present invention is the use 

0 of a track ball as a substitute for the traditional remote 

g|20 control device configuration of a circle of four (4) arrow keys 
W (up, down, left and right) with a select key in the center. 

In both the track ball and the joy stick embodiments, there 
is an on-screen "cursor." The viewer uses the track ball or joy 
stick remote control device to navigate the cursor to any 
25 location on the screen, much as a PC user navigates a cursor on 
a PC terminal window. 

3. Contextuallv Sensitive EPG On-Screen Control 
Mechanisms . 

30 "Keys," "buttons," menu "bars," and other such visual 

control mechanism devices are displayed on-screen for the control 
of the EPG. Typically, the visual control mechanism devices are 
sensitive to user-interaction. Typically, the viewer uses the 
UI remote control device to highlight a particular on-screen 

35 control device. Typically, the viewer then uses the UI remote 
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control device to select the highlighted on screen control 
device . 

In one embodiment of the present invention, positionally 
constant on-screen control devices are contextually sensitive. 
That is, a particular button can be consistently displayed on 
every screen of the EPG in the same position and with the same 
color, from one screen to the next, from one mode to the next. 
With contextually sensitive control devices, even though the on 
screen control device has the same appearance and placement from 
one screen to the next and from one mode to the next, the button 
has a different function, and if selected, will provide a 
different result, depending upon the screen on which the button 
appears. In one embodiment, the function of the on-screen 
control device is textually described next to the control device, 
or, if the control device is sufficiently large, on the face of 
the control device. 

For instance, in one embodiment, as illustrated in FIGS. 3, 
4a and b, 5, and 6, the EPG displays two buttons at the top of 
each of the four screens pictured. In each of the four different 
screens, the top left button has a different function. (As 
referred to in this application, the directions "left" and 
"right" refer to the viewer's left and the viewer's right, 
respectively.) FIG. 3 depicts the EPG' s on-screen Grid Guide in 
the programming scrolling mode. In FIG. 3, the viewer' s-left 
button is described as "Watch." FIGS. 4a and 4b depict the EPG' s 
on-screen Grid Guide in the channel-scrolling. In FIG. 4a and 
b, the viewer' s-left button is a toggle button, alternately 
described as "Lock" and "Unlock." FIG. 5 depicts the EPG in the 
Watch Scheduling Function. In FIG. 5, the viewer ' s-left button 
is described as "Cancel." FIG. 6 depicts the Watch/Record 
Schedule screen of the EPG. In FIG. 6, the viewer ' s-left button 
is described as "Remove." 
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4 . Watch Scheduling. 

The EPG provides the viewer with the opportunity to select 
5 program titles, scheduled for delivery at future times, to watch. 
By selecting program titles, the viewer builds a "watch list." 
Watch list options and instructions provide functionality 
parallel to the EPG' s Record Function. Instead of automatically 
recording the programs selected, the Watch Function automatically 
10 turns the television on, if it is not already on, and 
automatically tunes the television to the channel scheduled to 
deliver the designated program, if the television is not already 
tuned to that channel. This feature provides the viewer with the 
opportunity to watch a program of special interest at the 
15 scheduled time even if the viewer has forgotten about the 
scheduled delivery. This feature will also provide for parental 
selection of program viewing for children. 

The viewer can enter the Watch Scheduling Function in a 
13 number of ways. The viewer can enter the Watch Scheduling 

It 20 Function by selecting that Function from the EPG menu. The 
flf viewer can also enter the Watch Scheduling Function by 

highlighting an Ad Window displaying an advertisement for a 
future-scheduled program or a Virtual Channel Ad Slot displaying 
an advertisement for a future-scheduled program (both of which 
25 are described elsewhere in this application) . 

The viewer can designate any program on the Watch List as 
a program that the viewer wants to watch regularly. In one 
embodiment, if the viewer enters the Watch Scheduling Function 
by highlighting an Ad Window or Virtual Channel Ad Slot, then if 
30 the viewer chooses to designate the program as a "regular" watch, 
the designation expires after a certain amount of time if the 
advertiser stops running the advertisement. The planned 
expiration is an incentive to the advertisers to renew their 
advertisements . 

35 
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5 . "All Channel " Guide Format, Channel Guide Format and 
"Next"/ "Previous " Channel Guide. 

5 The viewer can choose to view the Grid Guide in an "all 

channel" format which displays in some order every channel and 
the listings of programs already in progress or scheduled to 
begin at some time in the future. In the "all channel" format, 
the viewer scrolls up and down the listings for each channel and 
10 from left to right and right to left to view the listings for a 
channel scheduled for different times during the day. Typically, 
the left-most portion of the guide begins with the earliest 
scheduled programs and continues to the right serially through 
;fi the listings scheduled at later times during the day. 

* 15 As an alternative, the viewer can choose to view the 
& programs scheduled for one channel at a time (a "Channel Guide ") . 

* In this format, the viewer scrolls up and down the listings for 

O 

fn a single channel as scheduled for different times of the day. 
O Typically, the "top" of the Channel Guide begins with the 

S20 earliest scheduled program and continues serially through the 
listings scheduled at later times during the day. FIG. 9 is a 
graphic representation of a sample on screen EPG display 
depicting the Channel Guide function of the EPG. 

In the "Channel Guide" format, the viewer can select to view 
25 the Channel Guide for the "next" channel or for the "previous" 
channel. In one embodiment, the "Next" and "Previous" Channel 
Guide is an option on one of the EPG menus, action buttons or 
task bars. In another embodiment, the viewer's remote control 
device provides "Next" and "Previous" Channel Guide keys. In 
3 0 another embodiment, the viewer uses the up and down arrow keys 
to navigate to the next or previous Channel Guides. 



35 
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B. Improved Viewer Control Of Video Recording Of Future- 
Scheduled Programming 

5 

1 . Recording program displayed in PIP window. 

As explained in more detail below, the EPG provides for 
multiple "windows." One window displays the currently tuned 
program. When the viewer enters the EPG from the television 
10 mode, the PIP window is "highlighted. " In one embodiment, 
highlighting of the PIP window is accomplished by a color change 
of the border around the PIP window. While the PIP window is 
highlighted, the viewer can instruct the EPG to record the 
displayed program. In one embodiment, the viewer records the 
S! 15 displayed program in the highlighted PIP window by pressing the 
P record button on the viewer's remote control device. 

* 

If 2 . Recording "Regularly . " 

ill 

p| One embodiment of the present invention provides the viewer 

jp 20 with the option of recording a particular program ''regularly . " 

rt 

The "regularly" option can be selected when the viewer highlights 
a particular program title on the EPG Grid Guide. Viewer 
selection of the "regularly" option instructs the VCR control 
system to record the particular title on the selected channel at 
25 the selected time slot any day of the week that the program is 
telecast. If a telecast of the selected title is preempted by 
another program, the new program is not recorded. The change in 
the telecast schedule is determined by comparing the title of the 
selected program to the title of the program actually telecast. 
3 0 In one embodiment of the invention, it is assumed that the title 
of the program actually telecast is carried in the vertical 
blanking interval of the television signal. When the viewer has 
instructed the EPG to "regularly" record a particular program, 
if the selected program is preempted by another program, the 
35 preempting program is not recorded and the EPG displays a message 
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notifying the viewer that the selected program was preempted and 
was not recorded. 

5 

3 . Record Function rerun filter for "Regularly" recorded 
programs . 

The EPG is capable of detecting reruns. The identification 
of the program as a rerun may be carried in the VBI of the 
10 program broadcast. In another embodiment, the rerun 

y identification information is available in the program detail. 

In one embodiment of the Record Function, when the viewer selects 
||| the "Regularly" record option, the viewer is also given the 

P option of filtering reruns. If the viewer selects the rerun 

2 15 filter option, then every time the program is regularly 
M scheduled, the EPG determines whether or not the program episode 

L to be delivered is identified as a rerun. If the episode is a 

f|f rerun, and if the viewer has selected the rerun filter option for 

fe| that program title, then the EPG will not record the episode. 

rtl 4 . Skip recording instruction. 

In the EPG's Record Function, the viewer selects a program 
title for recording. Once a program title has been selected, the 
viewer is asked to select a record-scheduling option. The viewer 

25 can select Once, Daily, Weekly, or Regularly as a record- 
scheduling option. If the viewer has selected a record- 
scheduling option of Daily, Weekly, or Regularly, one embodiment 
allows the viewer to skip recording of the program one time. The 
One-time skip instruction would result in the EPG not recording 

30 the program title, even though the record instruction for that 
program title remained in the record list. 

In the EPG's Record Function, the viewer can turn select the 
skip instruction for all programs on the Record List, or for 
selected programs on the Record List. This feature might be used 

35 when the viewer goes on vacation. The programs remain on the 
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Record List. At the viewer's option, the viewer can turn off the 
skip instruction for all programs on the Record List, or for 
5 selected programs on the Record List. 

5 . Automatic Record List Update, 

In the EPG's Record Function, the EPG will detect changes 
in program scheduling as compared to record instructions for 
10 particular program titles designated for recording. In one 
| 4; embodiment, when the EPG detects program scheduling changes, the 

13 Record List is automatically updated with the schedule change 

c l 

|K information. For instance, if a sports event runs longer than 

pi the originally scheduled time, a packet of scheduling update 

15 information can be transmitted over the VBI that updates the time 

fab - 1 - *-' 

U of the programs scheduled to be telecast after the sports event. 

The EPG detects the VBI scheduling updates and updates the 
Hi recording list to permit the recording of any programs following 

© the sports program to be recorded as appropriate. 

S 20 

I } j 6 . Recording on recordable Digital Video Discs. 

The viewer can instruct the EPG to record programs on 
recordable Digital Video Discs (DVD's). Because of the extended 
storage capacity of DVD's, the viewer can instruct the EPG to 

25 record and index an extended period of programming. For 
instance, the viewer can instruct the EPG to record and index, 
e.g., 4 hours of CNN news broadcasts certain number. When the 
viewer is ready to view the DVD recording, the EPG displays the 
DVD index on screen. The viewer can then select to view either 

30 the entire DVD, or only those portions of the recording in which 
the viewer is interested. 

In one embodiment, program-level indexing of recorded 
programs is created. In another embodiment, intra-program 
indexing is created by using information transmitted in the VBI 

35 of the video transmitted. In this embodiment, a recording of CNN 
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would likely show indexing breakdowns that include themes, such 
as "International News," "National News, " "Sports," 
"Entertainment," "Business & Finance," and "Weather." 

In yet another embodiment, intra-program indexing is created 
using some constant time interval. The index shows a start and 
end time interval, and audio content excerpts. 

In still another embodiment, indexing software analyzes the 
audio content of the program recorded ("Content Analysis 
Program") . This is typically in addition to using all indexing 
breakdown information transmitted in the VBI of the program. The 
Content Analysis Program uses speech and voice recognition 
technology to analyze, -among other things, such variables as: 
changes in announcers, changes in tone, changes in speed, topical 
words, geographic locations, substantive words. The Content 
Analysis Program then creates a topical index in addition to the 
theme index described above. 

7 . Speed Sensitive Tape Capacity. 

The EPG's Record Function provides a Record List that 
identifies the titles of programs that the viewer has selected 
to be recorded. The speed sensitive tape capacity feature uses 
color coding to identify in one color the titles that would fit 
on one tape at a fast tape speed and to separately identify, with 
another color, the titles that would fit on one tape at slow tape 
speed. 

8 . Record Instruction Conflict Resolution. 

The EPG's Record Function recognizes conflicts in viewer 
record instructions. In one embodiment, the EPG's Record 
Function prompts the viewer to resolve the conflict. For 
instance, in the Record Function, the EPG would accept viewer 
instructions to record a particular program. The EPG compares 
the newly received record instruction to as-yet incompletely 
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executed, or as yet unexecuted, record instructions in the Record 
List. If the EPG detects an overlap in date, time and duration 
5 between the newly received instruction on the one hand and one 
or more of the remaining record instructions in the Record List, 
the EPG formats a message to the viewer describing the conflict. 
The message describes to the user the newly received instruction 
to record a particular program and the conflicting record 
10 instructions in the Record List. In Record Function, the EPG 
will prevent entry of conflicting instructions into the Record 
pi List. The EPG will require that the viewer revise the record 
W instructions to eliminate the conflict. In one embodiment, if 
|l the EPG detects that one recording instruction pertains to a "one 
©15 occurrence" program that conflicts in date, time and duration 
1^ with a recording instruction to record a "regularly recorded" 
■* program, the EPG would format an on screen message that would 

iJ| suggest to the viewer that the viewer select the "one occurrence" 
D program to be recorded. In another embodiment, the EPG 
JE20 automatically "decides" to override the "regularly record" 
instruction and will record the "one occurrence" program with no 
further intervention by the viewer. 

One way to resolve a recording instruction conflict is to 
chose an alternative occurrence of the conflicting program for 
25 recording. In one embodiment of the EPG, the viewer can 
highlight a particular program in the EPG and request a list of 
all occurrences of that program for the week. The viewer can 
then instruct the EPG to record an alternative occurrence of the 
program. In an alternative embodiment, the viewer can view an 
30 alphabetical list of all programs for the week. The viewer can 
mark a program for viewing or recording from the alphabetical 
list . 



35 
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9 . Recording From Theme Guides. 

The EPG provides various Theme Guides, e.g., sports, movies, 
5 news, etc. When the viewer selects a particular Theme Guide, 
e.g., the Sports Theme Guide, the viewer can instruct the EPG to 
record an event while in the Theme Guide without having to exit 
the Theme Guide and go to the program Grid Guide. For instance, 
in the Sports Theme Guide, the viewer instructs the EPG to add 
10 a sports event to the Record List by clicking on the box score 
for a particular sports event and/or on the sports program 
listing in the Sports Theme Guide. 

|J C . IMPROVED FEATURES TO THE EPG DISPLAY AND NAVIGATION 

1815 

M i. E-mail . 

• In the preferred embodiment, the EPG interfaces with the 

13 Internet /World Wide Web. In the preferred embodiment, the viewer 
^2 can access the Internet to send and receive e-mail. 

*p20 In another embodiment, the television terminal is separately 

y addressable, and the head end controls e-mail traffic between 
viewers on its network. To facilitate two-way transmission a 900 
or toll free number is used as a back link. E-mail can then be 
sent to the appropriate viewer through the VBI to the viewer's 
25 separately addressable television. 



2 . Multiple Viewable "Windows . " 

The EPG UI screen provides for multiple viewable "windows." 
One window presents the EPG Grid Guide. Another window presents 

30 the picture-in-picture (PIP) window on which the currently tuned 
program is displayed. Another window displays advertising 
information (the "Ad Window") . Advertising may be in the form 
of graphics and textual information. Alternatively, advertising 
may be in the form of video display. In one embodiment, the Ad 

35 Windows are interactive. 
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As the viewer enters the EPG from the television mode, the 
PIP window is highlighted. The viewer can lock the PIP window. 
5 Locking the PIP window allows the viewer to continue to watch the 
television program being displayed in the PIP window while the 
viewer scrolls through the EPG program Grid Guide. Unlocking the 
PIP window causes the video for the program title highlighted in 
the Grid Guide to be displayed in the PIP window. 
10 As described further below, the viewer can also highlight 

fa the Ad Window. Doing so will cause additional text describing 
the product to be displayed in the detail box are of the EPG Grid 
J! Guide. 

Oj If the Ad Window displays information about a particular 

y ; 15 product, pressing a record button will instruct the EPG to record 
fa an infomercial, to the extent that one is scheduled for a future 
pi time. Alternatively, the Ad Window can display information about 
f|| a future-scheduled television program or about a series of 
w programs to be telecast over a period of time. In that case, 
1520 pressing a record button will instruct the EPG to record the 
& future-scheduled program. Alternatively, the viewer can 
designate the program for the Watch List. 

In one embodiment, the viewer navigates from the Grid Guide 
to the PIP Window by pressing the left arrow key until the 
25 cursor/highlighting reaches the PIP Window. From the PIP Window, 
the viewer uses the right arrow key to move back to the Grid 
Guide. In one embodiment, moving from the PIP Window to the Grid 
Guide causes the cursor to scroll to the very top of the Grid 
Guide lineup. From the top of the Grid Guide lineup, pressing 
30 the up arrow key moves the cursor to the navigation bar. The EPG 
provides several possible destinations on the navigation bar, 
e.g., info center, sports, news, set up, help, etc. 

From the PIP Window, pressing the down arrow key moves the 
cursor to the Ad Window. 

35 
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The viewer can set a default, or allow the system default, 
to highlight a particular navigation bar destination when the 
5 viewer initially enters the Grid Guide. 

In another embodiment of this invention, the position and 
size of the windows and other user interface features are 
customizable by the viewer. This feature is similar to the PC 
user's ability under a Microsoft Windows operating system to 
10 control the size and position of various functional windows. The 
difference here is that, in contrast to, e.g., a Windows 95 
operating system which allows the PC user to control the size 
and position of various functional windows on the face of a 
static PC monitor background, the present invention allows the 
W 15 television viewer to manipulate the PIP Window carrying a video 
y ; signal of a first television channel tuned by a first television 

% tuner and the various EPG Windows and EPG features on the face 

n 

£: of the television monitor, while the television monitor continues 

Q to receive a second video signal of a second television channel 

1*20 tuned by a second television tuner. 

w 
nj 

3 . Translucency on-screen effects. 

In one embodiment, the EPG creates special translucency 
visual effects. To create the translucency effect, the system 
25 alternates the display format pixel by pixel — one pixel is the 
color of the overlay and the next pixel is transparent. 

4 . On-screen notifications. 

The EPG formats on-screen notifications to the viewer and 
30 displays the notification to the viewer. On-screen notifications 
can be used to alert the viewer to any number of possible items 
of information. For instance, the EPG can notify the viewer that 
the EPG will begin recording a particular program within a 
certain amount of time, e.g., 2 minutes. The record notification 
35 could further ask the viewer whether to switch the cable box to 
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record the program. If the viewer indicated that the viewer did 
not want the EPG to switch to the cable box to record the 
5 program, then the EPG would delete the program from the record 
list. Another example would be to notify the viewer that a 
program that may be of interest (e.g., as determined from 
analyzing the Viewer's Profile) will be broadcast on another 
channel within a certain amount of time, e.g., 2 minutes. The EPG 
10 could then ask if the viewer wants to view the program on the 
^ other channel. If the viewer indicates that the viewer wants to 

CS watch the program on the other channel, then the EPG will 
automatically tune to the other channel at the appropriate time. 
CP Alternatively, the EPG could ask the viewer is the viewer wants 

|f 15 to record the program on the other channel and could then record 
M that program at the appropriate time if the viewer answers 

affirmatively. 

fis If the television is in television mode, the notification 

to will be displayed on-screen. The notification can be displayed 

ft 20 in a number of ways, including: 1.) a complete screen overlay; 
III 2.) a partial screen overlay; 3.) The real time program video is 

automatically changed to a PIP format, and the notification is 
displayed outside of the PIP window; 4.) The real time program 
video is automatically changed to a PIP format, and the 
25 notification is displayed inside of the PIP window; 5.) as a 
"watermark" somewhere on-screen; 6.) an on-screen icon is 
displayed which can be "pressed" by the viewer using the 
navigation keys on the viewer's remote control device, and which, 
if pressed, displays the notification in one of the above 
30 formats; 7.) the program video is compressed slightly to fit in 
some percentage, e.g., 90%, of the top of the screen, and the 
notification is displayed as a horizontally-rolling message at 
the bottom of the screen; 8.) the program video is compressed 
slightly to fit in some percentage, e.g., 90%, of the bottom of 

35 
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the screen, and the notification is displayed as a horizontally- 
rolling message at the top of the screen. 
5 If the television is in some mode other than the television 

mode, the EPG can notify the viewer through some modification of 
one of the above-described formats. For instance, if the 
television is in the Grid Guide mode in a PIP format, then the 
EPG could use any of format numbers 1.), 2.), 5.), 6.), 7.), 8.) 
10 or, the EPG could notify the viewer by displaying the 
notification in the Ad Window, a virtual ad channel slot, in the 

0 detail information window, or in a horizontally-rolling message 

P at the top or bottom of the screen. 

m 
tn 

W 15 5. Theme navigation bar. 

y : The theme display is above the top of the Grid Guide. In 

t one embodiment, the Grid Guide display provides for a "page up" 
on-screen button. In one embodiment, the Grid Guide display also 

t! provides for a "menu" button. The viewer can scroll to the top 

% 20 of the Grid Guide by successively "pressing" the page up on- 

fy screen button, or by "pressing" the menu button. 

6 . Improved Scrolling through the EPG and Smooth 
Scrolling. 

25 In the top level screen of the EPG in Grid Guide mode, the 

viewer user can jump directly to a future day of programming 
schedule information . 

In one embodiment, the Grid Guide display provides for a 
"page up" on-screen button. 

30 Program schedule information for a plurality of channels is 

displayed on a screen of the EPG in Grid Guide mode. Titles are 
shortened for display in the Grid Guide to conserve space. The 
entire title is available to the system and is displayed in the 
detailed description area of the Grid Guide when the viewer 

35 highlights a tile in the Grid Guide for the corresponding program 
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listing. But the EPG shortens the titles, according to a set of 
rules for shortening the titles, so that the titles fit in the 
5 scheduling tiles of the Grid Guide. 

The viewer can scroll up or down through the program 
listings. While scrolling, the titles are not drawn until the 
scrolling stops. Such a delay in drawing titles speeds up the 
processing and makes the screen appearance less confusing. While 
10 scrolling, the cursor will not highlight the top or the bottom 
u tile on the screen unless the channel is the top or bottom of the 
O lineup. The absence of highlighting signals to the viewer that 

gl more channels remain in the scrolled direction. 

fj! A further improvement to the EPG User Interface ("UI") is 

P 15 the development of "Smooth Scrolling." When the cursor reaches 

M 

the second tile from the bottom, and a new tile appears on the 

* bottom, the entire tile and its contents, e.g., a program title, 

CI 

fl grow gradually in height until the newly appearing tile reaches 
Q full tile height. At the same time, the tile that is 

p20 disappearing from the top of the screen, and the contents of that 
f|f top tile, shrink in height until the tile is gone. This provides 

a smooth transition in the overall screen display but is not 
actually perceptible because it is changing at 1/60 of a sec. 

Smooth Scrolling is less disorienting to the viewer than a 
25 page by page screen change, which is the scrolling technique used 
in existing on screen guides. The entire bit map does not need 
to be redrawn as you scroll up one tile — only the top tile is 
shrunk or compressed in the vertical dimension. 

In one embodiment, while slowly scrolling, the new title 
30 appearing on the screen is not redrawn until the scrolling stops. 
While rapidly scrolling multiple tiles, the processor stops 
redrawing the title on any of the tiles during the scroll; the 
processor waits until the scroll stops or slows down to redraw 
the titles. This permits faster scrolling because the titles do 
35 not have to be retrieved until the screen reaches the desired 
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point. Redrawing the data is very processor intensive. A 
special interaction between the firmware and the hardware is 
5 required to minimize redrawing the bit map and retrieving data 
from memory. This applies to both vertical and horizontal 
scrolling. The user can remain oriented because the channel 
identifiers and schedule times remain displayed. 

10 7 . "Jumping" in the EPG. 

The viewer can "jump" to the desired action or location in 

!f the EPG in a number of ways. In the Grid Guide, the viewer can 

CI 

p jump to the channel slot for a particular channel by entering the 

2? digits of the channel identification number on the key pad of the 

|p is viewer's remote control device. The EPG interprets the number 
M and calculates the proper position for the EPG cursor. The EPG 

then displays the cursor at the appropriate channel slot on- 

4 

CI screen. 

In one embodiment, the viewer's favorite and/or most watched 
£ 20 channels are displayed as buttons on a favorite channel selection 
fjf bar somewhere on the EPG display of the Grid Guide. The viewer 

can jump to one of the viewer's favorite channels by "pressing" 
the appropriate channel button. 

In another embodiment, the viewer's remote control device 
25 displays letters associated with the numbers on the key pad. The 
viewer can use a special "Alt" key to allow the viewer to press 
the keys as if alphabetic and/or alphanumeric. In this way, the 
viewer can enter a channel identifier, such as "CNN". 

In yet another embodiment, the viewer can request a pull 
30 down menu of favorite channel identifiers and can select a 
channel from the pull down menu. 

In yet another embodiment, the viewer can set "bookmarks" 
in the EPG by using a "bookmark" key on the viewer's remote 
control device, or alternatively, a "bookmark" button on the EPG 
35 display. The viewer can press the "bookmark" key when the user 
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wants to mark a current location for later return. The viewer 
can then scroll, jump, or otherwise navigate away to some other 
location in the EPG. When the viewer wants to return to the book 
marked location, the viewer can press the N> lastmark" key (on 
either the viewer's remote control device, or alternatively on 
the EPG display) . The EPG can record a plurality of book marked 
locations. In one embodiment, the EPG can remember book marked 
locations after the viewer turns off the television and then 
turns on the television multiple times. 

8 . Thematic color-coding of program schedule. 

The EPG categorizes programs according to a plurality of 
themes. In one embodiment, the EPG color codes the presentation 
of the program in the Grid Guide according to the theme 
categorization assigned to the program. 

9 . Controllable number of days of programming. 

Typically, the EPG will carry only 2 days of program 
listings. At the viewer's selection, the EPG can carry only a 
single day of program listings. The single day option provides 
a smaller range of program listings but increases response time. 
Alternatively, the viewer can select to carry any number of days 
of program listings, up to the number of days that is provided 
for by the particular installation, which is set by the 
corresponding amount of memory storage available. 

D. Parental Control Of The EPG Display 

The Parent viewer initially enters the Parental Control 
Function during initial EPG setup procedures. In the EPG setup 
procedure, the Parent identifies all viewers of the television, 
and assigns individual viewer Identifiers. The Parent viewer 
also establishes a password for said Parent viewer. ^"*^*U.S, 
Provisional Patent Application Serial No. 60/085.401 ("V-CHIP 
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Plus+: In-Guide User Interface Apparatus and Method for 
Programmable Blocking of Television and other viewable 
5 programming such as for Parental Control of a Television 
Receiver") describes Parental Control setup procedures for the 
identification of individual viewers and initialization of 
password protection, the disclosure of which is incorporated by 
reference here as if fully stated herein. 
10 In the Parental Control Function, the Parent selects the 

channels and programs that can be visible in the Grid Guide for 
|| a particular viewer and selects channels and/or programs that are 

||| to be blocked from viewing. Child viewers, as identified during 

IP setup procedure, will view a simplified Grid Guide and will be 

frl 

p 15 blocked from viewing the programs so marked by the Parent. In 
M one embodiment, individual viewers are identified by viewer ID 

and password. In another embodiment, individual viewers have 
different remote control devices, the use of which is also 
password protected. 



u 
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Improved Television Program Information Access By The 
Viewer 



1 . Virtual Channel Ad Slots and Ad Window program 

2 5 advertisements . 

As described below, the EPG provides the viewer with 
multiple opportunities to obtain detailed information about 
television programs. As is further described below, the EPG 
provides the viewer the opportunity to select Virtual Channel Ad 

3 0 Slots or Ad Window displays that advertise future-scheduled 

television programs and get additional information in the way of 
text or video clips. 

35 
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2 . Additional detailed information for viewer access 
including link to the Internet. 

The EPG displays detailed information relevant to program 
listings in the detailed information area of the Grid Guide. The 
detailed information can include, among other things, a detailed 
textual description of the program, information about the actors 
and actresses, information about the production of the program, 
product related information, identification of relevant Internet 
web sites and online Internet chat rooms. The EPG provides the 
viewer with the ability to request detailed information from such 
guides/data services in a number of ways, including when the 
viewer highlights: a particular program in the Grid Guide, the 
Ad Window, or a Virtual Channel Ad Slot. In one embodiment, the 
viewer's remote control device has a power "Information" key. 
When the viewer has navigated the on screen highlighting/cursor 
to a particular tile or window on the EPG on screen display, the 
viewer can press the remote control device "Information" key to 
request the additional information 

In one embodiment, when the viewer highlights a particular 
program in the Grid Guide, the Ad Window, or a Virtual Channel 
Ad Slot, or other requests access to detailed program-related 
information, the EPG connects the viewer with an external 
database of information, such as with a particular web site on 
the Internet . The viewer can instruct the EPG to connect the 
user with detailed specialized information guides/data services, 
such as sports, news, or other guides/data services. In one 
embodiment, the linking to the external data source is 
accomplished by storing a web site address with the Ad Window or 
Virtual Channel Ad Slot advertisement in the RAM of the user 
terminal . 

A sports program listed in the Grid Guide provides an 
illuminating example of how the viewer interacts with such a 
detailed specialized information guide/data service. When the 
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viewer highlights a football game listed in the Grid Guide, the 
normal detail concerning the program is displayed in the detailed 
5 information are of the Grid Guide. Furthermore, multiple icons 
related to the highlighted program can be displayed in the Grid 
Guide. One icon alerts the user that the game is already 
underway. Another icon indicates the availability of specialized 
guide information. The viewer can select the program from the 
10 Grid Guide for viewing and/or recording. In addition, the viewer 
can select the specialized guide icon. In the case of a sports 
program, selecting the specialized guide icon would display, for 
instance, a scoreboard for the game if the game were already in 
progress in the detailed information area of the Grid Guide. If 
|ll 15 the game were scheduled for a future time, then selecting the 
H specialized guide icon would display, for instance, information 
* about the players, the teams, and perhaps, the odds about the 

0 game . 

Another icon, displayed for instance in the display of the 

y 

|;;20 sports guide scoreboard, provides the viewer with the option of 

y 



w 

m 



connecting to the Internet, e.g., to a particular web site that 
provides additional information about the game, possibly, 
including online chat about the game. In one embodiment, the EPG 
switches to full screen to display of the Internet web site. In 
25 another embodiment, the EPG displays the Internet web site in the 
area of the screen previously occupied by the Grid Guide and/or 
the Grid Guide and the Ad Window, while continuing to display the 
real time video display of the currently tuned television program 
in the PIP window. Alternatively, the EPG can display the 
30 Internet web site in the PIP window and display the currently 
tuned television program in the area of the screen previously 
occupied by the Grid Guide and/or the Grid Guide and the Ad 
Window. The Internet web site to which the EPG initially 
connects (the "contact web site") may be a specialized directory, 
35 using pre-determined hyperlinks to the viewer to other cites of 
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interest. The contact web site may additionally, or in the 
alternative, offer search capabilities to the viewer to locate 

5 information of interest. 

Once the viewer is connected with a specialized information 
guide/data service, the viewer can use the guide/data service to 
direct the viewer to particular information contained in the EPG 
Grid Guide. For instance, a viewer selects a news program to 

10 watch. While watching the news program, the news broadcaster 
describes an event involving astronauts. The viewer selects the 
news guide/data service icon and connects to a web site on the 
j£| Internet describing, among other things, additional information 

fP about the particular event involving the astronauts. The viewer 

fn 

£, 15 uses the search engine offered by the contact web site to locate 

US 

M> additional information about the same astronauts. At the 
subsequent web sites, a Discovery Channel program is mentioned 

■i 

f3 concerning some of the same astronauts. The viewer instructs the 

\U EPG to locate any occurrence of the referenced program and to 

5*20 schedule that program to be recorded. In one embodiment, a PLUS 

CI CODE-like address is used to link to, or record, the scheduled 

hi 

program. 

The viewer can search an index, available on the Internet 
and created by a news data service, of recorded television news 

25 programs and reports. The viewer can search the index. If the 
viewer selects one of the indexed reports, a video clip of the 
indexed report will be shown in the area on the screen occupied 
by the Internet web site display, or any alternate area or 
portion of the on-screen display. The viewer can instruct the 

30 EPG to record the video clip. 

The EPG is capable of integrating additional information 
provided by the special data services into the EPG display. For 
instance, in the case of a sports data service, the EPG can 
format the program listing display and/or the sports scores for 

35 a game with special color coding depending upon the stage of the 
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game. For instance, if the game is in progress, the EPG will 
format the program listing and/or the sports scores for that game 

5 with one color, e.g., green; if the game is completed, the 
program listing and/or the final scores can be in a different 
color, e.g., blue. If the game is in progress, the viewer can 
highlight and select the box score to move from the box score to 
the game shown on the television. In one embodiment, the 

10 selected television sports program appears in the PIP Window or 
the Ad Window, allowing the viewer to read the sports program- 
related story in the sports guide while watching the 
ijl corresponding television sports program. 

P The EPG is further capable of linking between news items in 

P 

15 a special news guide and related television programs. The viewer 
U can link to a news program to watch or record that program by 

^ highlighting and selecting a news item in a news guide. In one 

f!j embodiment, the selected television news program appears in the 

PIP Window or the Ad Window, allowing the viewer to read the 
K 2 0 story in the news guide while watching a tv news program that 
fll reports on the event. 

In one embodiment, the VBI for selected channels are 
dedicated to the delivery of a special data service. For 
instance, the ESPN VBI would carry the sports data service only. 
25 In one embodiment, as an incentive to carry this data, the data 
service would display the ESPN TV program in the PIP window. 
Since the tuner must be set to ESPN to capture the data, the 
television signal is available for display in the PIP. 

30 



35 
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F. Improved Opportunities For The Commercial Advertiser To 
Reach the Viewer 

1 . Ad Window product-related video clips and infomercial 
recording 

The EPG provides producers of infomercials with extended 
capabilities to reach the viewers through the Ad Window. Because 
of the cost of buying advertising time, a growing number of 
product manufacturers and marketers produce infomercials about 
their products and then buy relatively inexpensive air time for 
their infomercials according to of f -prime-time schedules, often 
on non-prime channels. The EPG provides the producers of 
infomercials with the opportunity to provide the viewer with the 
opportunity to record an infomercial that is broadcast at a time, 
or on a channel, that would be inconvenient for the viewer to 
watch real-time. 

If the Ad Window displays information about a particular 
product, pressing a record button will instruct the EPG to record 
an infomercial or advertisement, to the extent that one is 
scheduled for a future time. Alternatively, the viewer can 
designate the infomercial or advertisement for the Watch List. 
Alternatively, the EPG provides the producers of infomercials 
with the opportunity to provide the viewer with the opportunity 
to view a video clip about the product being advertised. 

In one embodiment, the video clip associated with the 
product and/or program displayed in the Ad Window is shown when 
the viewer highlights the Ad Window. Depending upon the 
embodiment and/or viewer option selections, the video clip is 
shown in the PIP window, in the Ad Window, or full screen. At 
the conclusion of the video clip, the EPG typically returns to 
the mode in which the viewer was operating immediately before 
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selecting the option that triggered the display of the video 
clip . 

5 

2 . Ad Window program- related recording 

The EPG provides distributors of television programming with 
additional opportunities to reach the viewer. The Ad Window can 
display information about a future-scheduled television program. 
10 If the viewer is interested in recording the program, the viewer 
can take a number of alternative actions. For instance, in one 
j embodiment, the viewer can instruct the EPG to record the future- 

scheduled program. In one embodiment, the viewer presses record 
|jl button on the remote control device to instruct the EPG to record 

to 15 the future-scheduled program. Alternatively, the viewer can 
y instruct the EPG to add program to the Watch List. 

I Alternatively, the viewer can instruct the EPG to display a video 

ft 

clip about the program. Yet further, the viewer can instruct the 
g| EPG to connect the user with detailed specialized information 

20 guides/data services, such as sports, news, or other guides/data 

J 

II services. The EPG provides the viewer with the ability to 
request detailed information from such guides/data services in 
a number of ways, including when the, viewer highlights: a 
particular program in the Grid Guide, the Ad Window, or a Virtual 

25 Channel Ad Slot. In one embodiment, the EPG displays relevant 
detailed information in the detailed information area of the Grid 
Guide. In another embodiment, the EPG connects the viewer with 
an external database of information, such as with a particular 
web site on the Internet. 

30 

3 . Panel ads . 

In one embodiment, Panel ads occupy a fixed area in the 
Guide and are generally filled with paid advertisements. Located 
directly below the PIP in an Ad Window, space is available in the 
35 Guide for two Panel ads. Each Panel ad occupies approximately 



W 



-39- 



47840/RRT/I148 

l/9th of the total screen area. The usable area of a Panel ad 
is 132 pixels high x 160 pixels wide, with 2 pixel wide black 
borders all around and 2 pixels of gray on the left and right 
sides and between the two ad spaces. When a given ad space is 
not sold, the space will be filled with a Placeholder ad, stored 
in ROM, and inserted in the available space, or with a bonus ad. 

An advertiser may purchase both l/9th screen areas, thus 
creating a single ad with a usable space of 270 pixels high by 
160 pixels wide, with 2 pixel wide black borders all around and 
2 pixels wide of gray on the left and right sides. 

In one embodiment, all Guide screens are made up of "hard 
pages. " A hard page is defined as an area comprising 9 channel 
slots. Each time a user scrolls below the 9*x channel slot, a 
new "hard page" appears. Scrolling back up will bring the 
previous hard page back into view. Each hard page may have 
different Panel ads associated with it. 

In one embodiment, Hard pages are defined differently in the 
Sort screens. Each sort category (e.g. Movies, Sports, 
Children's) will be considered one hard page regardless of the 
number of items in the list vertically. As the user moves 
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Panel ad Pair 2 with channels 9-16 and the second 
Channel ad 

5 Panel ad Pair 3 with channels 17-20 and the third and 

fourth Channel ads 



If the user turned on more channels requiring the addition 
of a fourth hard page, then the fourth Panel ad Pair would become 
10 visible. 

In one embodiment, the user can highlight these ads, 
M resulting in the automatic display of an expanded information 
p box. This expanded information box covers the entire right-hand 
tP 2/3rds of the grid. The user closes the expanded information box 
to 15 b y moving the highlight off the Panel ad or by pressing the 
U information button after the last related information box screen 

has been presented. FIGS. 10a and 10b are graphic 

Qi representations of sample on screen EPG displays depicting one 

embodiment of the feature of presenting additional information 
%20 concerning the subject matter of a highlighted Panel Ad Window. 

Q In one embodiment, Panel ads are surrounded by flat black 

hi 

borders. When a panel ad is highlighted, the border turns 
yellow. When a program is set to record the border turns red 
(dark red when the Panel ad is not highlighted, light/bright red 

25 when highlighted) . When a program is scheduled to watch, the 
border turns orange (dark orange when the Panel ad is not 
highlighted, light/bright orange when highlighted) . 

In one embodiment, there can be multiple information 
"screens' 7 displayed sequentially in the expanded information box. 

30 Pressing the Info, button while an ad is highlighted accesses 
these additional screens. There is no finite limit to the number 
of additional screens; memory limitations and selling 
requirements will limit this number. 

In one embodiment, if a Panel ad is highlighted, has show 

35 information associated with it, and the advertised show is 
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currently on, the user may tune directly to the related program 
by pressing the Left Action button (the Blue button which is 
5 labeled "Watch") or by pressing the Enter/Select button on the 
remote. Pressing the Watch button also places the show in the 
Record/Watch Schedule for the duration of the show to allow the 
user to set the frequency to daily or weekly. If the show is not 
currently on, pressing the Left Action button places the show in 
10 the Record/Watch Schedule or; pressing the Enter/Select button 
? y tunes to the channel related to the show in the ad. Shows added 
S3 to the Record/Watch Schedule may be set to be viewed: once, 
lp daily, or weekly. The Watch feature and related Action button 
IP labels operate in the same way as if scheduling a show to watch 
f :r 15 from the Grid. 

M In one embodiment, if a Panel ad has show information 

JL ?: associated with it, the show may be recorded by highlighting the 
fy ad and pressing the Right Action button (the Green button, 
S labeled "Record") . If the show is on now, recording begins 
&20 immediately and the show is placed in the Record/Watch Schedule 
fll for the duration of the show to allow the user to set the 
frequency to daily or weekly. If the show is on in the future, 
that show is added to the Record/Watch Schedule for auto- 
recording. Shows added to the Record/Watch Schedule may be set 
25 to be recorded: once, daily, or weekly. The Record feature and 
related Action button labels operate in the same way as if 
scheduling a show to record from the Grid. 

In one embodiment, Panel ads can be dynamic. There are two 
areas which may be dynamic: 1.) the Panel ad space; and/or 2.) 
30 the Information box. 

The Panel ad area may change over time, e.g., every x 
seconds rotating through a plurality of different graphical or 
textual ad executions in the Panel ad space. When a Panel ad is 
highlighted, the ad rotation stops on the currently displayed ad 

35 
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visual. The dynamic rotation does not restart until the Panel 
ad is de-highlighted. 
5 The information box text associated with the Panel ad may 

change over time, e.g., every y seconds, rotating through a 
plurality of different screens of text. The screen rotation 
stops if the user presses the Info. Button, displaying the first 
page of info. text. This option is available for advertisers to 
10 rotate different headlines in the information box. The user may 
view subsequent pages by pressing the Info, button again. The 
screen rotation does not restart until after the Panel ad is de- 
fcl highlighted. 

81 

Pl5 4. Virtual Channel Ad Slots. 

til 

y a The EPG provides producers of infomercials with extended 

h* capabilities to reach the viewers through Virtual Channel Ad 
Slots, also referred to as Channel ads. Virtual Channel Ad Slots 
appear as rows of the Grid Guide and typically show the titles 
% J20 of the programs that are scheduled for a particular channel. The 
fg EPG Grid Guide's Virtual Channel Ad Slots provide advertisement 

Rj to be displayed as a row in the Grid Guides schedule of programs. 
The Virtual Channel Ad Slots may be used to provide multiple 
exposures of a particular program in the guide. The Virtual 
25 Channel Ad Slots act like a channel entry in the Grid Guide in 
that the viewer can record, watch, schedule for watching, and/or 
get information about the advertised program in the information 
detail box of the Grid Guide. 

In FIG. 1 of the drawing, tile 52 shows an example of a 
30 Virtual Channel Ad Slot for an ad for a television program — it 
is a program listing that is out of place channel-wise and time- 
wise in the Grid Guide 22. That is, it does not appear in the 
usual channel position or time position in the guide, but the 
tile is otherwise like the other program listing tiles of grid 
35 guide 22 (including height) , except that it occupies the entire 
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width of the tile irrespective of the duration of the program. 
A tile for a normal program listing scrolls off the screen as 
5 the up and down arrow keys are pressed. In contrast, in one 
embodiment, a Virtual Channel Ad Slot, such as shown in tile 52, 
remains on the screen at all times as the up and down arrow keys 
are pressed, so the ad remains in view at all times. 

Channel ads do not occupy a fixed area. Channel ads are 
10 essentially inserted between channels in the grid. If there are 
no Channel ads sold, the grid will simply be a continuous list 
of channels/show tiles with no gaps. As these channel ads take 
g up a channel slot in the grid, it is desirable to limit how many 

0 * 

f?| are likely to appear on any one screen to ensure the Guide is a 

r* 15 useful source of TV programming information. Typically, there 
will be approximately 1 Channel ad per hard page. 

Channel ads are typically the height of a channel slot, the 
p| width of the grid and are intermingled with the channel listings. 

P The usable area for a Channel ad is typically 24 pixels high x 
3? 20 344 pixels wide, with 2 pixel wide bevels all around, 
■fjj There are several types of Channel ads, including: 

Relative, Parent, and Fixed position Channel ads. 

Relative Channel Ads appear in a position relative to the 
top of the grid and are spaced every n channel slots, where n is 
25 some number. These ads appear and disappear as the user pages 
through the Guide's hard pages. It is anticipated that n will 
usually (but not necessarily always) equal 9 since this is the 
number of channels in the PIP version grid. This would provide 
for one ad per hard page. A location for the first ad can be 
30 selected on the first page and subsequent ads follow every n 
channel slots. The same ad is repeated every n th slot. This 
method of repeating every n th channel slot is true for both PIP 
and non-PIP versions. Typically, as a user turns channels off, 
the spacing of these ads remains constant (every n channel 
35 slots) . In the event that there are not enough channels to 
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continue this spacing, ads will appear at the end of the grid 
listings . 

5 Parent Channel ads are related to a specific channel located 

directly above the ad. A Parent Channel ad is attached to its 
adjacent "parent" channel (that is, the ad follows the parent 
channel) . As it is desirable to limit the number of Channel ads 
seen on any one screen, the number of Parent ads will typically 

10 be limited. Additionally, if the parent channel is turned off, 
the ad will typically be displayed at the bottom of the grid. 
^ Fixed Position Channel ads are located in one specific 

CI location, y (where y is some number) channels down from the top 

in 

fe: of the grid. If y is greater than the number of channels in the 

|r| 15 grid, the ad will be located at the end of the grid. 

I* Except as noted above regarding Parent and Fixed Position 

% Channel ads, Channel ads will typically be spaced so that no more 

ton 

W than one Channel ad is displayed at one time. 

In one embodiment, Channel ads page vertically along with 
#20 the channel listing information. These ads remain in a fixed 
^ position when the grid is scrolled horizontally. The user can 

highlight these Channel ads just as any show title can be 
highlighted. When highlighted, these Channel ads display 
additional information in the info, box just as when any channel 
25 is highlighted. 

Channel ads are typically surrounded by bevels just like any 
show tile. Channel ad highlighting is typically similar to Panel 
ad highlighting. In one embodiment, when a user highlights a 
Channel ad, the bevels change to a flat (non-beveled) yellow 
3 0 border. When a Channel ad show is set to record the border turns 
red (dark red when not highlighted, light/bright red when 
highlighted) . When a Channel ad show is scheduled to watch, the 
border turns orange (dark orange when not highlighted, 
light/bright orange when highlighted) . 

35 
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In one embodiment, Channel ads can have multiple, sequential 
info, box "screens" of information. The availability of this 
additional information is indicated by an "i" icon. The user can 
access the additional information by pressing the info, button. 

In one embodiment, if a Channel ad is highlighted, has show 
information associated with it, and the advertised show is 
currently on, the user may tune directly to the related program 
by pressing the Left Action button (the Blue button which is 
labeled "Watch") or by pressing the Enter/Select button on the 
.remote. Pressing the Watch button also places the show in the 
Record/Watch Schedule for the duration of the show. If the show 
is not currently on, pressing the Left Action button places the 
show in the Record/Watch Schedule for future auto-viewing; 
pressing the Enter/Select button tunes to the channel related to 
the show in the Channel ad. Shows added to the Record/Watch 
Schedule may be set to be viewed: once, daily, or weekly. The 
Watch feature and related Action button labels operate in the 
same way as if scheduling a show to watch from the Grid. 

In one embodiment, if a Channel ad has show information 
associated with it, the show may be recorded by highlighting the 
ad and pressing the Right Action button (the Green button, 
labeled Record) . If the show is already being delivered in the 
television signal, recording begins immediately and the show is 
placed in the Record/Watch Schedule for the duration of the show. 
If the show is on in the future, the show is added to the 
Record/Watch Schedule for recording. Shows added to the 
Record/Watch Schedule may be set to be recorded: once, daily, or 
weekly. The Record feature and related Action button labels 
operate in the same way as if recording a show from the Grid. 

Channel ads can be dynamic. 
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5 . Placeholder Ads 

5 In one embodiment, when the Guide is first setup, the 

initial download of information .will not have been received. The 
Panel ad spaces must be filled with Placeholder ads that are 
stored in ROM. These ads must be "timeless" as they will appear 
each time a TV is set up, either for the first time or after a 

10 power outage. 

One use for the Panel ad space is for help text. Help text 
that draws the user to select the ad space could serve as a 
"tutorial" on how to access Panel ads, the additional information 



on info, screens, and how to Watch and Record from ads. 

ft! 15 



N 6 . Full screen ads. 

When the viewer first enters the EPG, the EPG can display 
Q a full screen ad, such as an ad that would be displayed in the 
Ad Window. The viewer can interact with the full screen ad in 
E20 the same manner in which the viewer can interact with the Ad 
Window. That is, the viewer can instruct the EPG to record, or 
to add to the watch list, the infomercial or program, if there 
is one, that is associated with the advertisement. 



:■ v'v 
m i: 



2 5 7 . Automatic watch channel . 

Rather than have the last channel watched as the first 
channel 'tuned the next time that the viewer turns on the 
television, a channel selected by the viewer could be 
automatically tuned. In one embodiment, the viewer indicates the 
30 Automatic watch channel in the Watch List Function of the EPG. 
In another embodiment, a broadcaster sends an on-screen query to 
each viewer to enter a command if the viewer wants the 
broadcaster's channel to be the first watched channel when the 
viewer first turns on the television. 

35 
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0 



8 . Ad Features . 

Ads may feature, among other things, a graphics field, a 
5 text field or a combination of a graphics and text field. 

Graphics are typically presented in 8 bit/pixel (using "320 
mode") , 4 bit/pixel (in "640 mode") and 1 bit/pixel images. In 
some embodiments, there will be memory limitations. In 
embodiments with such memory limitations, it is expected that 
10 Panel ads will contain graphics no larger than 25% of the ad area 
when 4 or 8 bit/pixel graphics are used. 100% of the area may 
be used for a 1 bit/pixel graphic. Channel ad graphics will 
typically, but not necessarily, be limited to the channel logo 
!;: ; : portion of the ad. (The use of the word "typically" here, and 
0| 15 elsewhere in this application, means "typically, but not 
I necessarily.") The remaining portion of the Channel ad will 

i typically be text only. 

O Displayed text will typically have the following 

fll . 

characteristics : 

4*2 0 available normal and condensed 18 and 24 point fonts 

jj* oblique version of the fonts 

underlining 

bold 

centering 

25 left and right justification 

color can be selected once per line 

Text could also be displayed as a 1 bit/pixel bitmap 
in the Panel ad areas only. 

Background colors will have an impact on the overall look 
30 and usability of the Guide. The following describes a typical 
embodiment . 

Panel ad background colors may be selected by the advertiser 
and will typically be subject to luminance constraints set forth 
below. 

35 
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Channel ad background colors may be restricted. Show tile 
background colors are used as keys for show categories (movies, 
sports, etc.) and actions taken on a show (set to record or 
watch) . While most any background color could be displayed it 
is desirable to maintain the integrity of the show tile color 
schemes. Therefore, it is likely that a limited set of 
background colors or a set of colors which can not be used will 
be specified for advertising agencies to use when developing 
Channel ad creative. Channel ad backgrounds will typically be 
subject to luminance constraints set forth below. 

The Info, box background will typically be gray and 
typically can not be changed by the advertiser. 

There are typically limitations on the luminance of the 
colors in the ads. If the luminance is set too high, the screen 
image will blister. These limitations will be set, according to 
the embodiment, and communicated to the advertisers for their 
development consideration. Ads that do not comply with luminance 
restrictions for the particular embodiment will be subject to 
default override limitations. 

In one embodiment, the viewer can interact with the ads and 
the television. For instance, Tune-in ads will allow the viewer 
to tune directly to a show in progress from a highlighted ad 
block assuming the ad block has program information associated 
with it. An in progress show associated with an ad is directly 
tuned by pressing either the Enter/Select button or the Left 
Action button (the Blue button labeled "Watch") . 

Direct-record ads will allow the user to record a show in 
progress or scheduled to be on in the future from a highlighted 
ad block. There is no practical limit on how far into the future 
a direct-record associated show may be scheduled to air. A show 
associated with an ad is recorded by pressing the Right Action 
button while the ad is highlighted. The user may select a record 
frequency of once, daily or weekly. From an ad, the user presses 
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the Right Action button (the Green button labeled "Record") to 
place the show in the Record Schedule. In the event that the 
5 show is currently on, pressing the Right Action button while 
highlighting an ad allows recording of the show in progress. The 
show title is also placed in the Record Schedule until the show 
ends in the event the user wishes to modify the record frequency 
to daily or weekly. 
10 Watch ads consist of a program advertised in any ad space. 

The program advertised may be placed into the Watch Schedule as 
Jf long as the ad block has program information associated with it. 
|| There is no practical limit on how far into the future an 
associated show may be scheduled to air. The Watch feature 
IB15 operates much the same way as the Record feature, except that it 
H tunes the television ("TV") to the show rather than recording it. 

If a user is watching TV, the channel automatically changes to 
O a show placed in the Watch Schedule when the show begins. If the 
iSf TV is turned off when a show in the Watch Schedule is scheduled 
1*20 to begin, the TV is turned on and tuned to the desired channel 
y (TV implementations only, not VCR.) The user may select a watch 

frequency of once, daily or weekly. From an ad, the user presses 
the Left Action button (the Blue button labeled "Watch") to place 
the show in the Watch Schedule. In the event that the show is 
25 currently on, pressing the Left Action button while highlighting 
an ad results in tuning directly to the show. The show title is 
also placed in the Watch Schedule until the show ends in the 
event the user wishes to modify the watch frequency to daily or 
weekly. 

30 Ads may have multiple levels of information. Typically, 

First Level Information is the ad copy and/or graphics that are 
presented on screen with no user action. This comprises the 
Panel and Channel ad areas. 

Typically, Second Level Information (if provided by the 

35 advertiser) is automatically made visible ("Auto-Open") when the 
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user highlights an ad block by scrolling onto it. This secondary 
information is presented in the info, box when a Channel ad is 
5 selected and in an automatically expanded version of the info, 
box that covers the entire channel grid area when a Panel ad is 
highlighted. The "i" icon on the ad, placed at the advertiser's 
discretion, indicates there is more information available for 
that ad. The second level information may be text and/or 
10 graphics depending on memory availability. 
i. Typically, Third Level Information (if provided by the 

Ci advertiser) availability is indicated by the info, button xx i" on 

E a Second Level information screen. Pressing the info, button 

IP 

Si accesses this information and cause the information box to expand 

pl5 for Channel ads to cover the entire grid area. This information 

J** can be multiple pages long. Pressing the info, button successive 

L times cycles the user through the multiple pages. Pressing the 

n1 info. button from the last available screen causes the 

CI information box to contract to its original size for all ads. 

S ; 20 The third level information may be text and/or graphics depending 

u 

ftf upon memory capabilities. 

Ad Blocks can be dynamic. Memory permitting, the Panel ad 
graphics and/or text and information box text may change every 
X (where X is some number) seconds rotating through a limit of 
25 N (where N is some number) different graphical or textual 
executions. There is the capability to limit the number of 
dynamic ads displayed at any one time. 

Ad duration and start time/end time can be scheduled and/or 
dynamic. In one embodiment, ads are to be displayed at a given 
30 start time with a related end time. The time between the start 
and end is the ad's duration. The minimum duration increment is 
typically 60 seconds. In one embodiment, an ad will not be 
replaced automatically when an ad's end time arrives. Ads will 
only change when the user's actions cause a new "hard page," or 

35 
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new section of the guide to appear (e.g. going from the Grid to 
Sort) . 

5 Ads can rotate. For example, different ads can appear each 

time the user enters the same page/section of the Guide. There 
is no hard limit on the number of ads placed in rotation. Ads 
can be assigned a priority with the ad of the highest priority 
being displayed the first time a hard page or section is 
10 accessed. Then the second priority ad is displayed the next time 
jy : the user views this page and so forth. The priority counter is 
page dependent, meaning that if the user views the first page for 
|j| a third time, they will see the third priority ad on that page 
flj and if they then scroll to the second page for the first time, 
2 15 they will see the first priority ad on the second page. 
N Ads may differ by the section of the Guide being viewed. 

P For example, if a user is viewing the Sports theme area, an ad 

f|f for ESPN Sports Center may appear, whereas a different ad was 
if presented when the user was on the main grid. 

f|2 0 The EPG can determine which advertisements to display 

HI depending upon the advertisement being displayed on the 
television channel that the viewer was watching immediately 
before entering the EPG. That is, if a Toyota advertisement was 
being shown on the channel that the viewer was watching at the 
25 time that the viewer entered the EPG, then the EPG can be timed 
to display a correlative Toyota advertisement in some portion of 
the EPG, e.g., the Ad Window, a television program. 

In one embodiment, the EPG tests the Viewer Profile to 
determine which ad to display at various times during the 
30 viewer's session with the EPG. The EPG can assign Ad and Page 
priorities to represent the advertisers' investment and the 
relative viewer's profile. 

Graphically dynamic ads typically present different graphics 
every x seconds (where x is some number, with x as small as 1.0 
35 second) rotating through n (where n is some number) graphical or 
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textual executions. Typically, only a limited number of these 
ads will be displayed at any one time (likely a maximum of 1 per 
screen) as busy screens will decrease the effectiveness of the 
ads and the utility of the Guide. 

Ads must be "identif iable" and "accessible" once placed in 
memory in order to allow advertisers to "pull" an ad, to update 
an ad, or to correct errors in transmission. 

G. Improved Product Information Access By T he Viewer 

1 . Ad Window product detail. 

The viewer can highlight the Ad Window to locate additional 
information about the product advertised. In one embodiment, the 
viewer highlights the Ad Window by pressing the arrow/directional 
navigational keys of the remote control device to navigate the 
remote control device pointer to the location of the Ad Window 
on the on-screen television monitor display. When the remote 
control device pointer is located at the Ad Window on the on- 
screen television monitor display, the on-screen display of the 
Ad Window will be highlighted. In one embodiment, the color of 
the Ad Window itself will become brighter or show a lighted 
effect. In another embodiment, the color- of a border surrounding 
the Ad Window will become brighter or show a lighted effect. 
Highlighting the Ad Window will cause additional text describing 
the product to be displayed in the detail box are of the EPG Grid 
Guide. Alternatively, the EPG provides the producers of 
infomercials with the opportunity to provide the viewer with the 
opportunity to view a video clip about the product being 
advertised. 

The Ad Window can be optionally interactive. The Internet 
address of a web site containing information relevant to the ad 
being displayed in the Ad Window can be displayed in the Ad 
Window as a web site address, as an icon, or in some other 
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graphical presentation, such as a stylized "i" indicating 
additional interactive information. Furthermore, the viewer's 
5 interaction with the Ad Window will be monitored by the EPG to 
record as part of the viewer's profile. 

2 . Ad Window product-related recording 

The EPG provides viewers the opportunity to access extended 
10 product information about which the viewer is interested. 

Because of the cost of buying advertising time, a growing number 
t of product manufacturers and marketers produce infomercials about 
|l their products. Because of the cost of air-time, many 
P manufacturers and marketers buy relatively inexpensive air time 
|jl5 for their infomercials according to off-prime-time schedules, 
M often on non-prime channels. The EPG provides the viewer the 

opportunity to record an infomercial that is broadcast at a time, 
13 or on a channel, that would be inconvenient for the viewer to 
2J watch real-time. If the Ad Window displays information about a 
J 20 particular product, pressing a record button will instruct the 
P EPG to record an infomercial, to the extent that one is scheduled 

Pi S 

for a future time. Alternatively, the viewer can designate the 
infomercial for the Watch List. 

25 3 . Ad Window program-related recording 

The EPG provides viewers with additional opportunities to 
instruct the EPG to record or watch a future-scheduled television 
program. The Ad Window can display information about a future- 
scheduled television program. If the viewer is interested in 
30 recording the program, the viewer can instruct the EPG to record 
the future-scheduled program. In one embodiment, the viewer 
presses record button on the remote control device to instruct 
the EPG to record the future-scheduled program. Alternatively, 
the viewer can instruct the EPG to add program to the Watch List. 
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Alternatively, the viewer can view a video clip about the 
program. 

H. Creation of a viewer 7 s profile 

1. Collecting viewer profile information. 

The EPG requests that the viewer provide certain profile 
information, including but not limited to: the viewer's zip 
code; television, cable, and satellite services to which the 
viewer subscribes; the length of said subscriptions; the type of 
television; the age of the television; where the television was 
purchased; the viewer's top favorite channels; the viewer's 
favorite types of programs; and the times during which the viewer 
is most likely to watch television. If the viewer declines to 
provide this information, the EPG will attempt to "learn" the 
information as described below. 

In one embodiment, the EPG is capable of distinguishing 
between individual viewers and develops individualized profiles. 
For instance, in one embodiment, each viewer has an individual 
PIN or other identification number. In another embodiment, each 
viewer uses an individualized remote. In yet another embodiment, 
there is an absence of a way to distinguish one viewer from 
another. In that case, the profile is developed for the 
"family." 

Every time the viewer interacts with the EPG or the 
television, the EPG records the viewer's actions and the 
circumstances surrounding those actions. For instance, when the 
viewer changes channels, the EPG records, among other things, 
information about the first channel, the changed-to channel, the 
time that the change was made, the identification of the 
programming that was displayed on the first channel, the 
identification of the programming that was displayed on the 
changed-to channel, the time of the change, the identification 
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of any advertisement that was displayed on the first channel at 
the time of the change, the identification of any advertisement 
that was displayed on the changed-to channel, and whether the 
viewer changed channels while in one of the EPG modes, as opposed 
to being in the television mode. The EPG will also record every 
instruction by the viewer to record or watch a program, whether 
the instruction is Once, Daily, Weekly, or Regularly. The EPG 
will also record whether the viewer changes the volume of the 
television audio, and if so, what circumstances surrounded the 
change in volume. If the viewer changes channels while in one 
of the EPG modes, then the EPG records information about what was 
displayed in each of the windows of the EPG UI before and after 
the change. 

The EPG also records information when there is an absence 
of interaction between the viewer and the television or the EPG. 
For instance, the EPG will record whether a viewer continues to 
view an advertisement rather than changing channels. The EPG 
calculates and records the entire duration of the time that the 
television is on in any particular day. 

The EPG also records information surrounding the viewer's 
interaction with external sources of information, such as the 
Internet. For instance, the EPG records each search query 
criteria initiated by the viewer, the Search Engine used to make 
the search, the items selected by the viewer from the search 
response, interaction by the user with Internet sites, and viewer 
interactions with the EPG during the same time-frame as the 
viewer interacts with the Internet. 

An alternative to the above-described individual viewer 
profile information collection would be to provide on-screen 
survey queries. That is, the EPG could display an offer on- 
screen that would tell the viewer to call a toll-free number for 
the purpose of reading an on-screen encrypted number for the 
survey in exchange for a gift certificate. The offer could be 
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made only to viewers watching a particular program or particular 
advertisement at a particular time. Survey responses would 
5 provide useful information further survey customization, 
customizing the guide, and targeting advertising. 

2 . Analyzing and characterizing viewer profile 
information . 

10 The viewer profile information (data collected concerning, 

|, and surrounding, a viewer's interaction with the television, the 
0 EPG (including the recording and watching functions), the 
|J Internet, the World Wide Web, and any other sources of 
If! information external to the EPG, but through which the viewer 
rfl5 interact)) can be sent to a computer at the head end of 
|4 television distribution for analysis, or in the alternative, can 
* be analyzed by the EPG. 

fa I Information about the viewer is captured on an ongoing 

B basis. Similarly, viewer profile data is updated on an ongoing 
S-20 basis. Accordingly, the viewer profile analysis program (the 
f|| " Profile Program") , can be repeated at some time interval to 
incorporate additional information about the viewer that has been 
captured since the last analysis. Alternatively, the Profile 
Program is a real time program that processes each discrete item 
25 of information about a viewer as the data is captured. 

The viewer profile analysis program (the "Profile Program"), 
may be resident at the head end, in the Internet, included as 
part of the EPG, or distributed among these various possible 
locations. The Profile Program performs a variety of different 
30 types of analysis on the viewer profile data. For instance, the 
Profile Program performs simple statistical analysis of the data 
collected. The Profile Program accumulates, among other things, 
the number of times that the viewer: interacted with the EPG 
during a particular viewing session; performed particular types 
35 of interactions with the EPG; watched a particular channel; 
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interacted with the Internet during a particular viewing session, 
interacted with a particular website; watched and/or recorded 
5 and/or scheduled to watch a program with a particular type of 
theme (e.g., comedy, sports, drama, movie, sitcom, science 
fiction, adventure, mystery, documentary, cooking, travel, etc.); 
and watched and/or recorded and/or scheduled to watch a program 
with a particular type of subject (e.g., golf, tennis, football, 
10 basketball, baseball, animals, food, etc.), or a particular actor 
or actress. The Profile Program also calculates the duration of 
#\ each viewing and compiles, among other things, statistics about 

0 the times of day and days of the week during which the viewer 

|K watches television, interacts with the EPG, or interacts with the 

fit 15 Internet or the World Wide Web. 

Using the basic viewer profile data and the simple 
statistics collected about a particular viewer, the Profile 
& Program "learns" to recognize a finer breakdown about the various 

p| types of data collected and then uses the learned information to 

*p 20 describe a "Viewer Preference.". For instance, if the Profile 
tf! Program detects that the viewer watches sports programs, and that 

a number of sports programs are basketball games, the Profile 
Program analyzes the teams involved in the programs watched. The 
Profile Program is able, in this manner, to determine whether the 
25 viewer is a fan of a particular team. If so, the Profile Program 
records the viewer's team affiliation as a Viewer Preference. 

The Profile Program performs multiple levels of 
sophisticated analysis and learning involving numerous 
comparisons of the basic viewer profile data and the simple 
30 statistics collected about a particular viewer to develop Viewer 
Characteristics. In this way, the Profile Program develops a 
multi-dimensional profile of the viewer. For example, once the 
Profile Program detects a Viewer Preference, the Profile Program 
compares, e.g., the number of times that the viewer interacts 
35 with the EPG or an external information source such as the 
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Internet/World Wide Web, during a telecast of a program that 
relates to the Viewer Preference (e.g., a basketball game 
involving the viewer's favorite team) with, e.g., the number of 
times that the viewer interacts with the EPG or an external 
information source such as the Internet /World Wide Web, during 
a telecast of a program that does not relate to the Viewer 
Preference. 

Further, the types of interactions in both sets of 
circumstances are analyzed. In this way, the Profile Program 
determines Viewer Characteristics relating to, among other 
things: attention span; general interest in product 
advertisements; interest in specific types of product 
information; propensity for impulse buying; correlation of 
impulse buying habits to price ranges, product types, and 
advertising formats; interest in recording and/or watching 
future-scheduled programs; interest in accessing additional 
levels of information concerning television programs; and 
interest in accessing additional levels of information concerning 
product advertisements including the correlation of such interest 
with the Viewer Preferences. Over time, with sufficient data, the 
EPG characterizes the viewer's sense of humor, chronological age, 
activity age, whether the viewer is married, whether the viewer 
has children, whether the viewer has a pet and what type of pet 
the viewer likely has, whether the viewer is interested in buying 
a particular type of appliance, whether the viewer is considering 
buying a car, the viewer's likely political affiliations, and a 
broad range of various other Viewer Characteristics. 

Yet further, the Profile Program analyzes an individual's 
Viewer Profile as compared to the Viewer Profiles of others. 
With this cross-comparison analysis, the Profile Program can 
determine the likelihood that the subject viewer will prefer or 
be interested in a particular subject, product, theme, movie, 
episode, etc. based on comparisons to similar Viewer Profiles. 
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I . Utilization Of Viewer Profile Information To Customize 
5 Various Aspects Of The EPG 

The EPG and Profile Program use the basic viewer profile 
data, the simple statistics collected about a particular viewer, 
Viewer Preferences and Viewer Characteristics (collectively, 
hereinafter, the "Viewer's Profile' 7 ) to customize various aspects 
10 of the EPG. The viewer has the option to block any of these 
automatic customization features in the EPG Setup Mode. One 
P aspect of the EPG that will be customized is the order of the 
C| channel slots presented in the Grid Guide. The order in which 
tai the channel slots are presented can be customized to present the 
illlS viewer's favorite channels at the top/beginning of the Grid Guide 
;* in descending order according to the Viewer's Profile. 
l In one embodiment, the order of the channel slots is 

Cf customized according to the day of the week and the time of day 
^1 in accordance with the Viewer's Profile. For instance, if a 
4*20 particular viewer frequently watched Nick at Nite on weekday 
fc? evenings from 7pm to 10pm, then the EPG automatically tunes the 
television when turned on between 7 pm and 10pm, to the 
appropriate Nick at Nite channel and formats the Grid Guide to 
show the Nick at Nite channel as the first channel in the Grid 
25 Guide. If the same viewer typically watched ESPN during daytime 
hours on Saturday and Sunday, then the EPG automatically tunes 
the television when turned on between, e.g., 7 am through 7 pm 
on Saturday and Sunday to one of the ESPN channels and formats 
the Grid Guide to show the ESPN channels as the first several 
3 0 channels in the Grid Guide whenever the viewer enters the Grid 
Guide between, e.g., 7 am through 7 pm on Saturday and Sunday. 

At the viewer's option, the EPG and Profile Program use the 
basic viewer profile data, the simple statistics collected about 
a particular viewer, Viewer Preferences and Viewer 
35 Characteristics to perform automatic surfing. At the viewer's 
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option, auto surfing can be performed during real-time 
advertising telecasts. At the viewer's further option, auto 
surfing can be performed in PIP Watch Function, allowing the 
viewer to watch the program currently tuned in the main Picture 
Window, while providing auto surfing in the PIP Window. 
Alternatively, at the viewer's option, auto surfing can be 
performed in PIP Watch Function, allowing the viewer to watch the 
program currently tuned in the PIP Window, while providing auto 
surfing in the Main Picture Window. Still further, the viewer 
can choose the option of selecting a different advertisement to 
watch, or manually surfing channels of the viewer's choice. 

At the viewer's option, the EPG and Profile Program use the 
basic viewer profile data, the simple statistics collected about 
a particular viewer, Viewer Preferences and Viewer 
Characteristics to populate the Record List and/or the Watch List 
with programs that are likely to suit the viewer's interests. 
In one embodiment, searches for this type of information are 
conducted at a central computer at the head end. In another 
embodiment, queries are constructed and fed to an Internet search 
engine . 

At the viewer's option, the EPG and Profile Program use the 
basic viewer profile data, the simple statistics collected about 
a particular viewer, Viewer Preferences and Viewer 
Characteristics to search for news stories that are likely to 
suit the viewer's interests. The problem that is solved is 
automatically (without an editorial staff) choosing news stories 
from multiple news feeds for display to a particular viewer in 
a news service. The content of the audio portion of the news 
broadcast is digitized and can be stored at a central computer, 
on one or more web sites, on DVD's (both video and audio 
recordings) local to the particular viewer's television system, 
or in memory at the particular viewer's television system. In 



47840/RRT/I148 



addition to the audio content, video recordings of the news 
stories can also be stored. 

The Viewer's Profile, and in some embodiments, specific 
input from the viewer, is then used to construct data-mining 
search queries to locate and deliver content that matches the 
viewer's profiled interests and/or the viewer's specific requests 
for information. The news stories are then indexed (as described 
elsewhere in this disclosure) . The EPG presents the viewer with 
the customized index. In this way, the viewer selects the news 
stories for viewing in much the same way as the viewer selects 
television programs that the viewer wants to watch or record. 
Furthermore, web sites containing additional information 
concerning the indexed news stories can be posted, e.g., as part 
of the detailed description area text presented at the time that 
the viewer highlights a particular news story for viewing. 

In one embodiment, Theme Guides provide ''Smart Sorting" 
based on the Viewer's Profile (which is explained more fully 
elsewhere in this application) . That is, if a program is on two 
channels, the system will select the best channel based on which 
of the two channels the viewer watches more often. In one 
embodiment, the Theme Guides are further customized according to 
the Viewer's Profile. For instance, an information broadcast 
packet sent with the scores is used to order the score in the 
sports guide consistent with the Viewer's Profile. For instance, 
the score for a game involving the Boston Red Sox would display 
the scores for the Red Sox first for a viewer in Boston. 

During set up procedures, the EPG provides for automatic 
channel map selection. All channel maps in the viewer's zip code 
are downloaded. Zip code related options are displayed. In one 
embodiment, the viewer is asked to identify information necessary 
for the television to select the appropriate channel mapping 
option, but the television automatically selects the appropriate 
channel map. For instance, the viewer is asked to identify, e.g, 
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the distribution service to which the viewer subscribes, e.g., 
Colonial Cable, and a particular channel map, e.g., does the 
viewer receive HBO on channel 43. In this way, the viewer 
identifies the information necessary for the television to select 
the appropriate channel map. Alternatively, the viewer is 
actually asked to select the channel map, e.g., "if you have 
Colonial Cable and get HBO on channel 43, pick this channel map." 



j. Utilization Of Viewer Profile Information — To — Provide 
Customized Presentation Of Adver tising To The Viewer 

The EPG and the Profile Program use Viewer Profile 
information to tailor the presentation and scheduling of 
J 15 advertisements to the viewer and to customize the presentation 
U of the EPG for the user. For instance, the EPG uses Viewer 

t Profile information to determine whether to notify the viewer 

fij about scheduling for a program involving the viewer's favorite 

Cf team, a talk show involving a star player from that team, etc. 

m 20 The EPG is capable of such customized notification/advertisement 
A through e.g., an advertisement in the Ad Window, or through an 

advertisement in a Virtual Ad Channel Slot. 

Additionally, the EPG and the Profile Program use Viewer 
Profile information to customize the presentation and/or 
25 scheduling of telecast advertisements that are viewable during 
the real time telecast of the television program that the viewer 
is watching. One example is customizing an overlay message to 
an advertisement on a local geographic basis. For instance, the 
EPG knows the geographic location of the individual viewer. The 
3 0 broadcaster can packet match on the zip code to customize the 
message so each zip code gets a different message, i.e., the 3 
Burger Kings. in the viewer's local area. In one embodiment, the 
customized messages can be preloaded by zip code into the 
memories of particular viewers' EPG's. The preloaded messages 
35 can be transmitted by a head end during off hours and stored in 
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the viewer's terminal for use when the advertisement runs, e.g., 
during a television program or in a video clip in the Ad Window. 
The electronic trigger to run the message can be transmitted 
along with the television signal in real time and can identify 
the messages stored in the user terminal that need to be applied. 

In another embodiment, the customized messages are 
narrowcast with the televised advertisement. One way to 
narrowcast the customized messages is to embed the customized 
information in the advertisement video stream. Another way is 
to transmit a digital "watermark" in the video stream of the 
advertisement . 

In one embodiment, customization of real-time viewing of 
advertisements is achieved by providing multiple channels of 
advertising, by tuning the television automatically to a 
particular advertising channel at the time during the telecast 
of the television program during which an advertisement is 
scheduled to occur, and by then tuning the television back to the 
viewer's chosen television program at the conclusion of the 
advertisement. In another embodiment, a service monitors 
telecasts for advertisements as they are telecast on a particular 
channel and inserts a change channel command in the Vertical 
Blanking Interval (the "VBI") when an ad is telecast, said change 
channel command causing the television to tune to a particular 
channel for a telecast of an advertisement suitable to the 
Viewer's Preferences. 

Viewer Profile information can be reported, as with, for 
instance, statistical reports of Viewer Profile information for 
many viewers. These reports could be provided for analysis by 
advertisers, head end operators, Guide producers, or others, to 
determine, among other things, marketing customization 
opportunities, narrowcasting opportunities, program detail 
information requirements, and program distribution scheduling 
requirements . 



-64- 



47840/RRT/I148 



The EPG will attempt to capture the approximate initial 
purchase date (e.g.,, first turn-on date) of any 
television/entertainment system components. The EPG can notify 
the user at the appropriate time after the initial purchase of 
opportunities such as purchasing an extended warranty from the 
manufacturer. In one embodiment, the terminal equipment is 
separately addressable providing that such notification messages 
can be sent in the VBI to the appropriate viewer. Based on the 
Viewer Profile, the extended warranty offer could be tailored to 
the viewer's financial situation. 

Another way that the EPG uses Viewer Profile information is 
in connection with "access-content" customization of the 
advertising messages displayed by the EPG. Viewer Profile 
information will include the television program that the viewer 
was watching immediately before entering the EPG. The EPG can 
display different ads in the Guide or Service based upon the 
content of the television program that the viewer was watching 
before entering the EPG or one of the special data services 
accessible through the EPG. The "access-content" advertising 
strategy provides a much more refined way of targeting the 
consumer. For example, consider two viewers who are both 
watching television at 8:00 p.m. on a Tuesday night. When the 
one viewer who has been watching "Nova" enters the EPG, the EPG 
might display an advertisement for educational computer; whereas 
when the second viewer who has been watching Major League 
Baseball enters the EPG, the EPG might display an advertisement 
for Goodyear Tires. 

In one embodiment of this invention, a data base of 
advertising messages and virtual channel ads is stored in RAM at 
the viewer terminal or is accessible at a web site if the viewer 
terminal has an Internet connection. In either case, the 
advertising items in the data base are labeled with coded 
categories that correspond to coded category labels assigned to 
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the telecast television programs. (Preferably, these are the 
same categories that are used to sort the programs in the on 
5 screen category or theme guide.) The category labels of the 
television programs could be stored in RAM as part of the EPG 
data base and retrieved from the applicable Show Information 
Package ("SIP") based on the information from the real time clock 
and the tuner setting. This information identifies a time and 
10 channel that points to the applicable SIP. After the category 
label of the last program the viewer was watching in the 
^ television mode is retrieved from the EPG data base, this label 
jSjj is matched to the corresponding label in the data base of 
0 advertising messages and virtual channel ads stored in RAM. In 
ffiilS FIG . 1 of the drawing, the advertising items to which the labels 
M 5 are attached are displayed in ad windows 14 and 16 and the 

virtual channel ad displayed on tile 52 as described above. 
Q Yet another way that the EPG uses Viewer Profile information 

is in connection with "adjacent-content" customization of the 
advertising messages displayed by the EPG. Viewer Profile 
information will include identification of the content that the 
viewer has currently highlighted in the EPG or related data 
service. Using this method, the EPG displays different 
advertisements depending upon, e.g., which show the viewer has 
25 currently highlighted in the Grid Guide, what sport is 
highlighted in a sports data service, or what type of news is 
highlighted in a news service (international, local, etc.). 

The EPG can select advertisements from various possible 
locations, including but limited to: a library of advertisements 
30 stored at the viewer's terminal in RAM that have been downloaded 
through the VBI, stored at the head-end, or accessible through 
an EPG link to the Internet /World Wide Web. The advertisements 
may be in the form of graphics, text, video clips, audio clips, 
and combinations thereof. Each advertisement can be assigned 
35 theme codes, profile codes, and other selection intelligence. 
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In one embodiment, in order to customize the advertising display, 
the EPG searches the library of available advertisements to 
locate advertisements that match criteria set by the advertisers 
for "access content," "adjacent content," and/or Viewer Profile 
information. In another embodiment, the EPG selects 

advertisements for display according to pre-established selection 
criteria . 

The disclosures of the following patent applications are 
incorporated fully herein by reference: International 
Application WO96/07270; Application No. 60/053,330 filed July 21, 
1997; Application No. 60/061,119 filed October 6, 1997; and 
Application No. 60/055,237 filed August 12, 1997. 

In one embodiment, the advertisements in the library are 
assigned to themes; the history of use of an on-screen theme 
menu or program guide is recorded; and the history is analyzed 
by the EPG microprocessor to decide which advertisement to 
display. 

For example, a particular advertisement for automobiles 
might be assigned to a sports event theme. In a simple 
implementation, this automobile advertisement would be selected 
for display, if the users of the particular EPG selected sports 
as a theme more frequently than any other theme during a 
prescribed period of time. FIG. 7 represents the on screen 
display for the top level theme screen; and FIG. 8 represents the 
on screen display for the second-level theme screen. A theme 
selection could be recorded when a viewer highlights a theme in 
FIG. 7, such as "Sports". Selecting a theme brings up a screen 
listing, by time, channel, and title, of the programs that are 
consistent with the selected theme on a second-level theme 
screen, an example of which is shown in FIG. 8. The history of 
use could be recorded in a memory by overwriting the oldest data 
stored in the memory. If desired, a more sophisticated analysis 
could be used. Thus, the frequency of selection could be 
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weighted to favor more recent selections over older selections 
or themes could be combined to determine which advertisement to 
display. 

In another embodiment, the advertisements in the library are 
assigned to particular television programs or classes of 
television programs; the history of use of the information box 
of the EPG is recorded, in terms of frequency of the visits, time 
spent during a single visit, and/or total time of all the visits; 
the information boxes are correlated to the television programs, 
and the results are analyzed to decide which advertisement to 
display. Instead of the information box, any other area of the 
EPG screen could be monitored in similar fashion to decide which 
advertisement to display. In each case, the advertisements in 
the library are assigned to the types or subjects of information 
displayed in the monitored area so as to target better the 
advertisements to the interests of the users. 

In another embodiment, the advertisements in the library are 
also assigned to particular television programs or classes of 
television programs in terms of channel and time; the tuner is 
monitored; the channel and time are correlated to the television 
programs, and the results are analyzed to decide which 
advertisement to display. 

For example, an advertisement for brand name athletic shoes 
with a popular basketball star could be assigned to basketball 
programs. The shoe advertisement would be selected for display 
if the viewer of the particular EPG entered the EPG while 
watching a basketball game. 

In another embodiment, the advertisements in the library are 
also assigned to particular television programs or classes of 
television programs; the history of television programs entered 
into a "record-watch list" as shown in FIG. 6 is recorded; and the 
results are analyzed to decide which advertisement to display. 
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The time of the monitored event can also be taken into 
account in order to distinguish between multiple users of the 
same EPG or related television receiver. The assumption is that 
the people using the EPG and watching television at different 
times of the day have different interests — housewives may use the 
EPG more in the morning, children may use it in the early 
evenings, and men who work outside the home may use it on Sunday 
afternoons . 

History of use as described above can be combined with the 
"access-content" model described in Application No. 60/055,237 
to further pin-point advertisements to the user's interests. 
Thus, if the users of the particular EPG selected comedies as 
a theme more frequently than any other theme during a prescribed 
period of time, three advertisements might be flagged and the 
final selection made therefrom depending upon which type of 
program the viewer was watching on television before switching 
to the on-screen EPG. 



